Posts: 22
Registered: ‎04-12-2016

hdfs balancer fail to move block



I'm using hadoop version 2.0.0-cdh4.3.0 and when i run hdfs balancer i get the following warning :threads quota is exceeded.

I understood that Datanodes will limit the number of threads used for balancing so as to not eat up all the resources of the cluster/datanode. This is what causes the WARN statement i'm seeing, but i git that i can run an updated balancer without upgrading the cluster.

Can anyone guide me how i can run it? is it any other solutions?



Posts: 768
Registered: ‎05-16-2016

Re: hdfs balancer fail to move block

The only work around is to use this property "dfs.datanode.balance.max.concurrent.moves " in the datanode  which is not possible unless you upgrade your cluster. I believe you cant use upgrade blancer without upgrading .