How to keep kafka producer running continuously ?

[#1]

If I use below command to get data from my_file.txt, it captures all the data and I can get it at consumer console. If my_file.txt is continuosly updating then how can I keep my producer running and keep producing latest data?

kafka-console-producer.sh --broker-list localhost:9092 --topic my_topic < my_file.txt

[#2 · Accepted solution]

did you try tail -f file | kafka-console-producer.sh --broker-list localhost:9092--topic my_topic

[#3]

@Rajkumar Singh - Thank you! It works.

[#4]

I would also use NiFi's TailFile processor and PutKafka to achieve what you're doing.

[#5]

Thank you @Artem Ervits