Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Huge Kafka __consumer_offsets topic

avatar
Frequent Visitor

I have a problem with the topic __consumer_offsets, the topic is very large, kafka metrics show that I have 4 billion messages on it, I suspect that message compaction does not work correctly, I constantly see an increase in new messages in the metrics on this topic (however, the total log dir size fluctuates periodically between 19 and 20 GB). What could be the reason that this topic is not being cleaned up?

1 REPLY 1

avatar
Community Manager

Welcome to the community @Mhl. While you wait for a direct response, I did find a similar post that may be of interest. 

Keep the questions coming