Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Node rebalancing

Node rebalancing

New Contributor

I am currently working on a cluster that is on CDH 5.4.0.

 

The data appears to be distributed evenly across its data nodes. However this is not the case for the volumes of the individual nodes.

 

Is there a way to rebalance the volumes of a node so that the data is spread evenly within it? If so, what is the recomended approach?

2 REPLIES 2

Re: Node rebalancing

Champion

did you try runining the HDFS balancer using command line or cloudera manager 

is that something you would consider ? 

 

https://www.cloudera.com/documentation/enterprise/5-7-x/topics/admin_hdfs_balancer.html#cmug_topic_5...

Re: Node rebalancing

New Contributor
Just run it via the command line following the documentation.

What I am trying to achieve is described in the below. However this feature is only available to CDH 5.8.2. Any idea how it can be done in 5.4.0? Are there any steps?

https://blog.cloudera.com/blog/2016/10/how-to-use-the-new-hdfs-intra-datanode-disk-balancer-in-apach...
Don't have an account?
Coming from Hortonworks? Activate your account here