I set up everything as recommended for a quick start, I used a text file as a source or producer which contains one sentence. when I launch a consumer console for the first time I am able to read the sentence (JSON format) in the file but when I add something in the file it's not showing in the consumer console and when I use the producer console to add something in the topic, it shows right the way in the consumer console. What could be the problem?
Thanks for reaching out to the Cloudera community.
You can use "tail" command and then pipeline it to Kafka console producer if you want to read the whole file and then continue tailing for subsequently appended lines.
$ tail -f -n +1 <filename> | kafka-console-producer --broker-list <Broker_Host>:9092 --topic <topic_name>
Let me know if this helps.