Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

ERROR hdfs.HDFSEventSink: process failed JDBC Channel


ERROR hdfs.HDFSEventSink: process failed JDBC Channel

New Contributor


I am unable to ingest avro file compressionCodec = Snappy using avro client. Please see below Flume config file , please help me to resolve the issue


a1.sources = avro
a1.sinks = hd
a1.channels = jdbc

a1.sources.avro.type = avro
a1.sources.avro.bind = localhost
a1.sources.avro.port = 11112

a1.sinks.hd.type = hdfs
a1.sinks.hd.hdfs.path = /user/cloudera/problem7
a1.sinks.hd.hdfs.fileSuffix = .avro
a1.sinks.hd.hdfs.fileType = DataStream
a1.sinks.hd.serializer = avro_event
a1.sinks.hd.serializer.compressionCodec = snappy
a1.sinks.hd.serializer = org.apache.flume.serialization.AvroEventSerializer.Builder

a1.channels.jdbc.type = jdbc

a1.sources.avro.channels = jdbc = jdbc


commands :


flume-ng agent -n a1 -f <</path/configfile>>

flume avro-client -H localhost  -p 11112 -F <<path/Avrocompressed file >