Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

hdfs balancer fail to move block


hdfs balancer fail to move block




I'm using hadoop version 2.0.0-cdh4.3.0 and when i run hdfs balancer i get the following warning :threads quota is exceeded.

I understood that Datanodes will limit the number of threads used for balancing so as to not eat up all the resources of the cluster/datanode. This is what causes the WARN statement i'm seeing, but i git that i can run an updated balancer without upgrading the cluster.

Can anyone guide me how i can run it? is it any other solutions?




Re: hdfs balancer fail to move block


The only work around is to use this property "dfs.datanode.balance.max.concurrent.moves " in the datanode  which is not possible unless you upgrade your cluster. I believe you cant use upgrade blancer without upgrading .