Reply
Contributor
Posts: 36
Registered: ‎07-15-2015
Accepted Solution

Kafka Consumer is not working in CDH5.13.0 Kafka version : 0.10.2-kafka-2.2.0

[ Edited ]

Hi,

 

 

I've been getting problems with the consumer in CDH5.13.0. For other CDH-5.11.0 and CDH-5.12.0 versions with Kafka version : 0.10.2-kafka-2.2.0 are working fine. Added advertised.listeners also and i'm running in a non-secure environment. Observed client.id is blank for console consumer whereas it is client.id = console-producer for producer. I need to work with CDH-5.13.0,please help me out

 

When I run the old API consumer, it works by running

bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test --from-beginning

However, when I run the new API consumer, I don't get anything when I run

bin/kafka-console-consumer.sh --new-consumer --topic test --from-beginning  --bootstrap-server localhost:9092

 

 

Contributor
Posts: 36
Registered: ‎07-15-2015

Re: Kafka Consumer is not working in CDH5.13.0 Kafka version : 0.10.2-kafka-2.2.0

Resolved by deleting brokers data from zookeeper
Thanks.
New Contributor
Posts: 1
Registered: ‎02-26-2018

Re: Kafka Consumer is not working in CDH5.13.0 Kafka version : 0.10.2-kafka-2.2.0

How you deleted broker data from zookeeper??

 

I am having similar issue, with old --zookeeper, consumer is working fine however --bootstrap-server it is not working.

 

Kindly help?

Contributor
Posts: 36
Registered: ‎07-15-2015

Re: Kafka Consumer is not working in CDH5.13.0 Kafka version : 0.10.2-kafka-2.2.0

bin/zookeeper-shell.sh    <zookeeper_host:port>:2181

 

If you want to delete only topics

rmr /brokers/topics

 

 

for deleting brokers 

rmr /brokers

New Contributor
Posts: 1
Registered: ‎11-21-2018

Re: Kafka Consumer is not working in CDH5.13.0 Kafka version : 0.10.2-kafka-2.2.0

Check if

offsets.topic.replication.factor

(or probably other config parameters related to replication) is not higher than the number of brokers. That was the problem in my case.

Highlighted
Explorer
Posts: 9
Registered: ‎01-05-2018

Re: Kafka Consumer is not working in CDH5.13.0 Kafka version : 0.10.2-kafka-2.2.0

I am using CDH 5.13 and CDK 4.0 (apache 2.1). Getting the same problem. However, consumer is still not getting messages after deleting brokers and topics as suggested by you. 

Announcements

Our community is getting a little larger. And a lot better.


Learn More about the Cloudera and Hortonworks community merger planned for late July and early August.