Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: The Cloudera Community will undergo maintenance on Saturday, August 17 at 12:00am PDT. See more info here.

Logging Avro object into Hbase (separate columns) via Flume

Logging Avro object into Hbase (separate columns) via Flume

Explorer

I'm using Flume to collect logs coming in avro format into Hbase. When I use the SimpleAsyncHbaseSerializer, the entire avro object gets logged into one hbase column. I would like to each field in the avro object to be logged into a separate column in hbase. Would this require a custom event serializer or can it be accomplished through other means (like using a combination of morphline commands)?

1 REPLY 1
Highlighted

Re: Logging Avro object into Hbase (separate columns) via Flume

New Contributor

I am trying to:

1) create Avro objects in variables that can

2) be stored in different Hbase columns

 

I can find examples of how to combine data and a json schema and write the whole thing to a file, but I need the Python code that will just put the data and definition into a variable.