Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

HDFS diskbalancer

SOLVED Go to solution

HDFS diskbalancer

Expert Contributor

Hello, 

 

Can i run HDFS disk balancer for multiple hosts simultaneously. I tried it and it throws an error which is misleading as already one iteration is in progress.

 

19/05/15 07:19:24 ERROR tools.DiskBalancerCLI: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.diskbalancer.DiskBalancerException): Disk Balancer is not enabled.

 

Thank you,

Des

1 ACCEPTED SOLUTION

Accepted Solutions

Re: HDFS diskbalancer

Master Guru
The Disk Balancer sub-system is local to each DataNode and can be triggered
on distinct hosts in parallel.

The only time you should receive that exception is if the targeted DN's
hdfs-site.xml does not carry the property that enables disk balancer, or
when the DataNode is mid-shutdown/restart.

How have you configured disk balancer for your cluster? Did you follow the
configuration approach presented at
https://blog.cloudera.com/blog/2016/10/how-to-use-the-new-hdfs-intra-datanode-disk-balancer-in-apach...?
What is your CDH and CM version?
1 REPLY 1

Re: HDFS diskbalancer

Master Guru
The Disk Balancer sub-system is local to each DataNode and can be triggered
on distinct hosts in parallel.

The only time you should receive that exception is if the targeted DN's
hdfs-site.xml does not carry the property that enables disk balancer, or
when the DataNode is mid-shutdown/restart.

How have you configured disk balancer for your cluster? Did you follow the
configuration approach presented at
https://blog.cloudera.com/blog/2016/10/how-to-use-the-new-hdfs-intra-datanode-disk-balancer-in-apach...?
What is your CDH and CM version?