Datanode Balancer bandwidth configuration

[#1]

Hello,

Trying to configure Datanode balancer network bandwidth to 4 GB since we have a good 25 GBPS network dedicated to the cluster. However, when set via Cloudera Manager, I get an alert stating max allowed in 1 GB.

Is it something hard coded and cannot be increased beyond 1 GB via CM? OR there is a different way to do that?

Thanks
snm1523

[#2 · Accepted solution]

Hi @snm1523 

It is a CM restriction to change the dfs.datanode.balance.bandwidthPerSec more than 1 GB but can be achieved from CLI

Example -

nohup hdfs balancer  -Ddfs.datanode.balance.bandwidthPerSec=4294967296 > /tmp/balance_log.out &

[#3]

Thank you for the help, Shubham.

Thanks
Snm1523