Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

One disk of the datanode is at 99% used...

Solved Go to solution

One disk of the datanode is at 99% used...

Contributor

Hi,

I Have a hadoop cluster 3.0.1 with 3 journalnodes, 1 nfsgateways node and 6 workernodes. I connected by ssh to the worker nodes today and realised by doing a "df -h" that one a the one local disk (/data/4) is around 94% used on every worker nodes whereas the others disk are between 50% and 65%...  

The HDFS status on the another hand is the following:

Disk Usage (DFS Used)          44.77%   28.1 TB / 62.8 TB
Disk Usage (Non DFS Used)  14.97% 9.4 TB / 62.8 TB
Disk Remaining                       40.26%  25.3 TB / 62.8 TB

 

What are the the elements i should check to make sure that a full local disk won't create any issue?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: One disk of the datanode is at 99% used...

Super Mentor

@Koffi 

If your DataNodes are unevenly distributed/loaded then HDFS provides an option to Balance them using the "HDFS Balancer" utility.

HDFS balancer utility helps to balance the blocks across DataNodes in the cluster. 

 

Via Ambari: https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/managing-and-monitoring-ambari/content/amb_reb...

Further Details: https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.4/data-storage/content/balancer_commands.html

.

1 REPLY 1
Highlighted

Re: One disk of the datanode is at 99% used...

Super Mentor

@Koffi 

If your DataNodes are unevenly distributed/loaded then HDFS provides an option to Balance them using the "HDFS Balancer" utility.

HDFS balancer utility helps to balance the blocks across DataNodes in the cluster. 

 

Via Ambari: https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/managing-and-monitoring-ambari/content/amb_reb...

Further Details: https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.4/data-storage/content/balancer_commands.html

.

Don't have an account?
Coming from Hortonworks? Activate your account here