Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Balancing kafka topics when new broker is added

Balancing kafka topics when new broker is added

Expert Contributor

Hi,

 

We currently have 3 kafka brokers and about 250 topics. How do i rebalnce the partitions and data when a new broker is added?

3 REPLIES 3

Re: Balancing kafka topics when new broker is added

Expert Contributor

I know we can use manual kafka partition reassignment. I'm looking for a better way and we will be adding more disks to the data directory of kafka as well.

Re: Balancing kafka topics when new broker is added

Super Collaborator
There currently isn't an automatic way to rebalance topics when adding brokers. kafka-reassign-partitions would be your best option.

-pd

Re: Balancing kafka topics when new broker is added

Expert Contributor

Hi @pdvorak

 

Will adding additional disks also be the same?