Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Where does Kafka stores offsets in case of Automatic Offset Committing,

Where does Kafka stores offsets in case of Automatic Offset Committing,

New Contributor

As per Kafka documentation, Automatic Offset Committing, "Setting enable.auto.commit means that offsets are committed automatically." Can you help me understand where the offsets are stored in case of automatic offset committing.. I believe it used to be on Zookeeper but not anymore as per new KafkaConsumer API.

2 REPLIES 2

Re: Where does Kafka stores offsets in case of Automatic Offset Committing,

New Contributor

@vinay nallapeta

offsets are stored in a special compacted Kafka topic named "__consumer_offsets"

Highlighted

Re: Where does Kafka stores offsets in case of Automatic Offset Committing,

Expert Contributor

Second the answer by @mkumar

Also check out the link below. Some good writeup which I found gives much details on it

http://wanwenli.com/kafka/2016/11/04/Kafka-Group-Coordinator.html

Don't have an account?
Coming from Hortonworks? Activate your account here