Support Questions
Find answers, ask questions, and share your expertise

Kafka consumer not seeing all messages

Kafka consumer not seeing all messages

We run HDP kafka version 0.10. We moved from 0.9xx to 0.10 at some point. One of the consumer apps was not migrated from Kafka client lib <version></version> to <version></version>. Issue seen:

The consumer with 0.9xx client library was not seeing all the events from all partitions(only some) from the topic subscribed while the one with the most recent 0.10xx client was seeing all the events. Is this expected for not having the most closest client library version compatible with the server version for Kafka?

Another - Comment is that we tried redeploying the Kafka cluster after which

How to fix it? Not seeing any errors on Kafka server logs.