Reply
Highlighted
New Contributor
Posts: 1
Registered: ‎05-10-2019

Kafka Connect HDFS connector (HDInsights)

[ Edited ]

Hi all,

 

We are getting the following issue with the HDFS Connect Kafka Connector

 

[2019-05-08 10:10:41,820] INFO Opening record writer for: hdfs://headnodehost//topics//+tmp/rstest/partition=1/b9f2fd9d-9dcd-4853-b5a1-dabcf9928884_tmp.avro (io.confluent.connect.hdfs.avro.AvroRecordWriterProvider:66)

and no data is written, when we close the connector, this error occurs

[2019-05-08 10:14:51,370] ERROR Error discarding temp file hdfs://headnodehost//topics//+tmp/rstest/partition=1/b9f2fd9d-9dcd-4853-b5a1-dabcf9928884_tmp.avro for rstest-1 partition=1 when closing TopicPartitionWriter: (io.confluent.connect.hdfs.TopicPartitionWriter:451)
org.apache.kafka.connect.errors.DataException: java.nio.channels.ClosedChannelException
        at 

Please can someone help?

Thanks

 

Announcements