Support Questions

Find answers, ask questions, and share your expertise
Announcements
We’ve updated our product names and community labels - click here for full details

Huge Kafka __consumer_offsets topic

avatar
Frequent Visitor

I have a problem with the topic __consumer_offsets, the topic is very large, kafka metrics show that I have 4 billion messages on it, I suspect that message compaction does not work correctly, I constantly see an increase in new messages in the metrics on this topic (however, the total log dir size fluctuates periodically between 19 and 20 GB). What could be the reason that this topic is not being cleaned up?

1 REPLY 1

avatar
Community Manager

Welcome to the community @Mhl. While you wait for a direct response, I did find a similar post that may be of interest. 


Keep the questions coming,

Cy Jervis | Senior Manager, Knowledge Programs

if (helpful) { mark_as_solution(); } | if (appreciated) { give_kudos(); }