08-24-2016 10:42 PM
I'm using hadoop version 2.0.0-cdh4.3.0 and when i run hdfs balancer i get the following warning :threads quota is exceeded.
I understood that Datanodes will limit the number of threads used for balancing so as to not eat up all the resources of the cluster/datanode. This is what causes the WARN statement i'm seeing, but i git that i can run an updated balancer without upgrading the cluster.
Can anyone guide me how i can run it? is it any other solutions?
09-21-2016 08:31 PM
The only work around is to use this property "dfs.datanode.balance.max.concurrent.moves " in the datanode which is not possible unless you upgrade your cluster. I believe you cant use upgrade blancer without upgrading .