Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

HDFS diskbalancer

avatar
Expert Contributor

Hello, 

 

Can i run HDFS disk balancer for multiple hosts simultaneously. I tried it and it throws an error which is misleading as already one iteration is in progress.

 

19/05/15 07:19:24 ERROR tools.DiskBalancerCLI: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.diskbalancer.DiskBalancerException): Disk Balancer is not enabled.

 

Thank you,

Des

1 ACCEPTED SOLUTION

avatar
Mentor
The Disk Balancer sub-system is local to each DataNode and can be triggered
on distinct hosts in parallel.

The only time you should receive that exception is if the targeted DN's
hdfs-site.xml does not carry the property that enables disk balancer, or
when the DataNode is mid-shutdown/restart.

How have you configured disk balancer for your cluster? Did you follow the
configuration approach presented at
https://blog.cloudera.com/blog/2016/10/how-to-use-the-new-hdfs-intra-datanode-disk-balancer-in-apach...?
What is your CDH and CM version?

View solution in original post

1 REPLY 1

avatar
Mentor
The Disk Balancer sub-system is local to each DataNode and can be triggered
on distinct hosts in parallel.

The only time you should receive that exception is if the targeted DN's
hdfs-site.xml does not carry the property that enables disk balancer, or
when the DataNode is mid-shutdown/restart.

How have you configured disk balancer for your cluster? Did you follow the
configuration approach presented at
https://blog.cloudera.com/blog/2016/10/how-to-use-the-new-hdfs-intra-datanode-disk-balancer-in-apach...?
What is your CDH and CM version?