Support Questions
Find answers, ask questions, and share your expertise

flume - hive sink - avro

flume - hive sink - avro


Is it not possible to use the avro serializer with hive sink with flume?

Like :

r_hive.sinks.sink1.type = hive

rsa_hive.sinks.sink1.hive.metastore = thrift://master2:9083

r_hive.sinks.sink1.hive.database = menw

r_hive.sinks.sink1.hive.table = flume_hive

r_hive.sinks.sink1.serializer = org.apache.flume.sink.hdfs.AvroEventSerializer$Builder

r_hive.sinks.sink1.serializer.schemaURL = hdfs://host:8020/tmp/avroschemas-new/mf.json

I am seeing the error in flume log :

2019-01-07 16:19:18,360 ERROR org.apache.flume.node.AbstractConfigurationProvider: Sink sink1 has been removed due to an error during configuration java.lang.IllegalArgumentException: Unable to instantiate serializer: org.apache.flume.sink.hdfs.AvroEventSerializer$Builder on sink: sink1 at org.apache.flume.sink.hive.HiveSink.createSerializer(

Caused by: java.lang.ClassCastException: org.apache.flume.sink.hdfs.AvroEventSerializer$Builder cannot be cast to org.apache.flume.sink.hive.HiveEventSerializer

Don't have an account?