Reply
Expert Contributor
Posts: 85
Registered: ‎10-04-2017

Balancing kafka topics when new broker is added

Hi,

 

We currently have 3 kafka brokers and about 250 topics. How do i rebalnce the partitions and data when a new broker is added?

Expert Contributor
Posts: 85
Registered: ‎10-04-2017

Re: Balancing kafka topics when new broker is added

I know we can use manual kafka partition reassignment. I'm looking for a better way and we will be adding more disks to the data directory of kafka as well.

Cloudera Employee
Posts: 229
Registered: ‎01-09-2014

Re: Balancing kafka topics when new broker is added

There currently isn't an automatic way to rebalance topics when adding brokers. kafka-reassign-partitions would be your best option.

-pd
Highlighted
Expert Contributor
Posts: 85
Registered: ‎10-04-2017

Re: Balancing kafka topics when new broker is added

Hi @pdvorak

 

Will adding additional disks also be the same?

Announcements