Community Articles
Find and share helpful community-sourced technical articles
Labels (1)
hdfs dfsadmin -setBalancerBandwidth 100000000 

on all the DN and the client we ran the command below

hdfs balancer -Dfs.defaultFS=hdfs://<NN_HOSTNAME>:8020 -Ddfs.balancer.movedWinWidth=5400000 -Ddfs.balancer.moverThreads=1000 -Ddfs.balancer.dispatcherThreads=200 -Ddfs.datanode.balance.max.concurrent.moves=5 -Ddfs.balance.bandwidthPerSec=100000000 -Ddfs.balancer.max-size-to-move=10737418240 -threshold 5 

This will faster balance your HDFS data between datanodes and do this when the cluster is not heavily used. Hope this helps you.

9,213 Views
Don't have an account?
Version history
Revision #:
1 of 1
Last update:
‎08-18-2016 06:59 PM
Updated by:
 
Contributors
Top Kudoed Authors