Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Kafka consumer not seeing all messages

Highlighted

Kafka consumer not seeing all messages

We run HDP kafka version 0.10. We moved from 0.9xx to 0.10 at some point. One of the consumer apps was not migrated from Kafka client lib <version>0.9.0.2.4.2.0-258</version> to <version>0.10.1.2.6.0.3-8</version>. Issue seen:

The consumer with 0.9xx client library was not seeing all the events from all partitions(only some) from the topic subscribed while the one with the most recent 0.10xx client was seeing all the events. Is this expected for not having the most closest client library version compatible with the server version for Kafka?

Another - Comment is that we tried redeploying the Kafka cluster after which

How to fix it? Not seeing any errors on Kafka server logs.

Don't have an account?
Coming from Hortonworks? Activate your account here