Flume BytesWritable issue with hive

[#1]

Hi,

I am ingesting data using flume to HDFS as a Sequence File (Bzip2Codec). I get the following at the top of the file after ingestion into hdfs:

SEQ!org.apache.hadoop.io.LongWritable"org.apache.hadoop.io.BytesWritable

When I query using hive, I get java.io.BytesWritable cannot be converted to java.io.Text.

I don't want to change my type to text in flume agent configuration file. Could you please provide me serde for the same in hive.

[#2 · Accepted solution]

I created my own serde to resolve the same 🙂