Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Kafka Segment

Highlighted

Kafka Segment

Contributor

What is segment in Kafka. What it does?

1 REPLY 1

Re: Kafka Segment

Super Collaborator

It splits each partition into smaller units, that enables the broker to have a smaller portion of data to be handled when new data is incoming. If you check the logs (persistent storage) of Kafka, each partition becomes a directory and each segment a file.

I think this is a nice explanation: https://thehoard.blog/how-kafkas-storage-internals-work-3a29b02e026