How to ingest HDFS data into Kafka

[#1]

Is there any better way to pull HDFS data into Kafka? I could use a flume exec source and kafka sink, but any alternative?

[#2 · Accepted solution]

You could use Apache NiFi with a ListHDFS + FetchHDFS processor followed by PublishKafka.

[#3]

Can you help to provide more insight on how we can able to achieve this?

Thank you

Srinu