Community Articles
Find and share helpful community-sourced technical articles
Labels (1)
hdfs dfsadmin -setBalancerBandwidth 100000000 

on all the DN and the client we ran the command below

hdfs balancer -Dfs.defaultFS=hdfs://<NN_HOSTNAME>:8020 -Ddfs.balancer.movedWinWidth=5400000 -Ddfs.balancer.moverThreads=1000 -Ddfs.balancer.dispatcherThreads=200 -Ddfs.datanode.balance.max.concurrent.moves=5 -Ddfs.balance.bandwidthPerSec=100000000 -Ddfs.balancer.max-size-to-move=10737418240 -threshold 5 

This will faster balance your HDFS data between datanodes and do this when the cluster is not heavily used. Hope this helps you.

Don't have an account?
Version history
Revision #:
1 of 1
Last update:
‎08-18-2016 06:59 PM
Updated by:
Top Kudoed Authors