Is there a way to write KAFKA messages to HDFS.
Any kind of suggestions owuld be of great help.
Indeed, yes for the archiving purpose ( not suggested for real time).
as the activity is straight forward, you may use flume to do that task with "Kafka source" and "HDFS sink" topology.
documentation can be found here
or you may use NiFi to do the same real time.
Hope that helps!!
Yes. This feature exists in many forms
Depending on what tools you have available, it's up to you to decide which makes the most sense.