Reply
Highlighted
Explorer
Posts: 22
Registered: ‎04-12-2016

hdfs balancer fail to move block

Hi,

 

I'm using hadoop version 2.0.0-cdh4.3.0 and when i run hdfs balancer i get the following warning :threads quota is exceeded.

I understood that Datanodes will limit the number of threads used for balancing so as to not eat up all the resources of the cluster/datanode. This is what causes the WARN statement i'm seeing, but i git that i can run an updated balancer without upgrading the cluster.

Can anyone guide me how i can run it? is it any other solutions?

 

 

Champion
Posts: 768
Registered: ‎05-16-2016

Re: hdfs balancer fail to move block

The only work around is to use this property "dfs.datanode.balance.max.concurrent.moves " in the datanode  which is not possible unless you upgrade your cluster. I believe you cant use upgrade blancer without upgrading .