Reply
Expert Contributor
Posts: 87
Registered: ‎09-17-2014

How to rebalance individual directory

hi dear experts!

 

i do have rebalanced (across DataNodes) HDFS directory.

it's not so big in Cluster scale (lile 1TB), so global rebalancer donesn't move this blocks (note: i use https://db-blog.web.cern.ch/blog/daniel-lanza-garcia/2016-04-tool-visualise-block-distribution-hadoo... to check distribution).

i could perform:

hadoop fs -mv /dir /dir2

hadoop fs -cp /dir2 /dir

hadoop fs -rm dir2

 

and it helps.

 

but does anyone knows more elegant and sophisticated solution?

 

thanks!

Announcements