i was pointinn to a wrong broker so the zk was unable to find the topics ... View more

thank you for your detailed reply.   sorry if i am digging this up, but i followed have a similar problem (topic partition 5 referencing a non-existent leader broker) and a replication factor of 1   i think this happened during a move of the topic from my colleagues.   anyhow i followed your instructions* and enabled the unclean leader election before restarting kafka as cloudera service via manager.   however, i am still receiving this line in the log of the supposedly new leader:   Broker xxx received LeaderAndIsrRequest with correlation id 1 from controller 1 epoch 1035 for partition [mytopic,5] but cannot become follower since the new leader [ID] is unavailable.  where ID is probably an old broker (i wouldnt know) but clearly not an active broker id (of which i have 3).   * with the exception that i did not generate a json file but wrote it myself, since only 1 partition needed id-correction and i entered the broker that already holds the partition data on disk ... View more

yes, thanks for the reply!  I figured out the same thing earlier today as I went back to the Flume User Guide and started copying and pasting the properties in again...    When I reviewed my config initiall, i didn't look before the attribute name to even see I was missing "hdfs".  Definitely an ID10T and PEBKAC error. 🙂   Thanks for keeping me honest! ... View more

Yes I found the solution. There was one more parcel "CDH5", which I activated first and then I was able to activate Kafka. But one more issue is when I tried to add the Kafka as a service, then I am facing error as "Supervisor retuned fatal. Please check the role log file, stderr or stdout". What is this issue again. Please help me. ... View more

If you are using the exec source to tail a file, keep in mind that it is not a very reliable source. I would suggest using the taildir source (https://archive.cloudera.com/cdh5/cdh/5/flume-ng/FlumeUserGuide.html#taildir-source) to tail files reliably. -pd ... View more

But how would he fix it, if he did need it?? I am experiencing the same thing. ... View more