Reply
New Contributor
Posts: 2
Registered: ‎08-24-2017

Node rebalancing

[ Edited ]

I am currently working on a cluster that is on CDH 5.4.0.

 

The data appears to be distributed evenly across its data nodes. However this is not the case for the volumes of the individual nodes.

 

Is there a way to rebalance the volumes of a node so that the data is spread evenly within it? If so, what is the recomended approach?

Champion
Posts: 564
Registered: ‎05-16-2016

Re: Node rebalancing

[ Edited ]

did you try runining the HDFS balancer using command line or cloudera manager 

is that something you would consider ? 

 

https://www.cloudera.com/documentation/enterprise/5-7-x/topics/admin_hdfs_balancer.html#cmug_topic_5...

Highlighted
New Contributor
Posts: 2
Registered: ‎08-24-2017

Re: Node rebalancing

Just run it via the command line following the documentation.

What I am trying to achieve is described in the below. However this feature is only available to CDH 5.8.2. Any idea how it can be done in 5.4.0? Are there any steps?

https://blog.cloudera.com/blog/2016/10/how-to-use-the-new-hdfs-intra-datanode-disk-balancer-in-apach...
Announcements