Support Questions
Find answers, ask questions, and share your expertise

How to rebalance individual directory

How to rebalance individual directory

Rising Star

hi dear experts!

 

i do have rebalanced (across DataNodes) HDFS directory.

it's not so big in Cluster scale (lile 1TB), so global rebalancer donesn't move this blocks (note: i use https://db-blog.web.cern.ch/blog/daniel-lanza-garcia/2016-04-tool-visualise-block-distribution-hadoo... to check distribution).

i could perform:

hadoop fs -mv /dir /dir2

hadoop fs -cp /dir2 /dir

hadoop fs -rm dir2

 

and it helps.

 

but does anyone knows more elegant and sophisticated solution?

 

thanks!