Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Flume BytesWritable issue with hive

avatar
Explorer

Hi,

 

I am ingesting data using flume to HDFS as a Sequence File (Bzip2Codec). I get the following at the top of the file after ingestion into hdfs:

 

SEQ!org.apache.hadoop.io.LongWritable"org.apache.hadoop.io.BytesWritable

 

When I query using hive, I get java.io.BytesWritable cannot be converted to java.io.Text.

 

I don't want to change my type to text in flume agent configuration file. Could you please provide me serde for the same in hive.

1 ACCEPTED SOLUTION

avatar
Explorer

I created my own serde to resolve the same 🙂

View solution in original post

1 REPLY 1

avatar
Explorer

I created my own serde to resolve the same 🙂