Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Ambari displays incorrect disk space

Solved Go to solution

Ambari displays incorrect disk space

Explorer

Hi Team ,

we have 2 node cluster with HDP version 2.5.3.0 and Ambari 2.4.0.1 and each data node is having almost 21TB of disk capacity.

But in Ambari web UI it displaying incorrectly as 29.2 GB.

12473-disk-remaining.png

Please help.

Many Thanks.

12474-disk-2.png

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Ambari displays incorrect disk space

In HDFS -> Configs, check have you assigned your disks as NameNode and DataNode directories. In particular, in DataNode dirs. you should have one directory for each of your disks you want to be used for HDFS. In your case 10-11 of them, all except the one for the OS. Ambari is aware only of disk space assigned in this way.

View solution in original post

7 REPLIES 7
Highlighted

Re: Ambari displays incorrect disk space

In HDFS -> Configs, check have you assigned your disks as NameNode and DataNode directories. In particular, in DataNode dirs. you should have one directory for each of your disks you want to be used for HDFS. In your case 10-11 of them, all except the one for the OS. Ambari is aware only of disk space assigned in this way.

View solution in original post

Highlighted

Re: Ambari displays incorrect disk space

Expert Contributor

Check the directories entry assigned in HDFS config, Ambari will consider only these directory space,for reference check the below image,12481-untitled2.png

Highlighted

Re: Ambari displays incorrect disk space

That's strange. Can you check 2 more places: (1) on Ambari Dashboard, put the mouse over "HDFS disk usage", what do you see there for DFS used, non DFS used, and remaining? (2) HDFS -> Quick Links -> NN UI, what's your "Configured capacity"?

Highlighted

Re: Ambari displays incorrect disk space

Explorer

Hi All ,

i just found the solution one of my team member forgot to include datanode disks in (dfs.datanode.data.dir).

Thanks.

Highlighted

Re: Ambari displays incorrect disk space

Good to know! Then, please considder to upvote and/or accept my first answer above. Tnx!

Highlighted

Re: Ambari displays incorrect disk space

Explorer

Accepted ,Thanks :)

Highlighted

Re: Ambari displays incorrect disk space

Explorer

I faced this issue recently. Turns out that one of my datanodes was decomissioned (due to earlier maintenance). You might try checking the list of datanodes from the dfshealth page. Using default ports, for me it was:

<<mynamenode>>:50070/dfshealth.html#tab-datanode

That would list the datanodes and their status (active, decomissioned, space, etc...)

Also note that recent versions of Ambari will give that link under HDFS Summary "Quick Links" dropdown (its called "Namenode UI")

Don't have an account?
Coming from Hortonworks? Activate your account here