If I use below command to get data from my_file.txt, it captures all the data and I can get it at consumer console. If my_file.txt is continuosly updating then how can I keep my producer running and keep producing latest data?
kafka-console-producer.sh --broker-list localhost:9092 --topic my_topic < my_file.txt
did you try tail -f file | kafka-console-producer.sh --broker-list localhost:9092--topic my_topic
View solution in original post
@Rajkumar Singh - Thank you! It works.
I would also use NiFi's TailFile processor and PutKafka to achieve what you're doing.
Thank you @Artem Ervits