Reply
Expert Contributor
Posts: 103
Registered: ‎10-04-2017

Balancing kafka topics when new broker is added

Hi,

 

We currently have 3 kafka brokers and about 250 topics. How do i rebalnce the partitions and data when a new broker is added?

Expert Contributor
Posts: 103
Registered: ‎10-04-2017

Re: Balancing kafka topics when new broker is added

I know we can use manual kafka partition reassignment. I'm looking for a better way and we will be adding more disks to the data directory of kafka as well.

Highlighted
Cloudera Employee
Posts: 277
Registered: ‎01-09-2014

Re: Balancing kafka topics when new broker is added

There currently isn't an automatic way to rebalance topics when adding brokers. kafka-reassign-partitions would be your best option.

-pd
Expert Contributor
Posts: 103
Registered: ‎10-04-2017

Re: Balancing kafka topics when new broker is added

Hi @pdvorak

 

Will adding additional disks also be the same?

Announcements

Our community is getting a little larger. And a lot better.


Learn More about the Cloudera and Hortonworks community merger planned for late July and early August.