question Re: Ambari displays incorrect disk space in Archives of Support Questions (Read Only)

Ambari displays incorrect disk space

reddyr211 — Mon, 19 Aug 2019 11:59:29 GMT

Hi Team ,

we have 2 node cluster with HDP version 2.5.3.0 and Ambari 2.4.0.1 and each data node is having almost 21TB of disk capacity.

But in Ambari web UI it displaying incorrectly as 29.2 GB.

Please help.

Many Thanks.

Re: Ambari displays incorrect disk space

pminovic — Wed, 15 Feb 2017 06:10:19 GMT

In HDFS -> Configs, check have you assigned your disks as NameNode and DataNode directories. In particular, in DataNode dirs. you should have one directory for each of your disks you want to be used for HDFS. In your case 10-11 of them, all except the one for the OS. Ambari is aware only of disk space assigned in this way.

Re: Ambari displays incorrect disk space

rajsyrus — Mon, 19 Aug 2019 11:59:15 GMT

Check the directories entry assigned in HDFS config, Ambari will consider only these directory space,for reference check the below image,

Re: Ambari displays incorrect disk space

pminovic — Wed, 15 Feb 2017 14:45:27 GMT

That's strange. Can you check 2 more places: (1) on Ambari Dashboard, put the mouse over "HDFS disk usage", what do you see there for DFS used, non DFS used, and remaining? (2) HDFS -> Quick Links -> NN UI, what's your "Configured capacity"?

Re: Ambari displays incorrect disk space

reddyr211 — Thu, 16 Feb 2017 06:34:07 GMT

Hi All ,

i just found the solution one of my team member forgot to include datanode disks in (dfs.datanode.data.dir).

Thanks.

Re: Ambari displays incorrect disk space

pminovic — Thu, 16 Feb 2017 06:45:16 GMT

Good to know! Then, please considder to upvote and/or accept my first answer above. Tnx!

Re: Ambari displays incorrect disk space

reddyr211 — Thu, 16 Feb 2017 11:02:09 GMT

Accepted ,Thanks 🙂

Re: Ambari displays incorrect disk space

tshiels — Tue, 18 Apr 2017 02:00:09 GMT

I faced this issue recently. Turns out that one of my datanodes was decomissioned (due to earlier maintenance). You might try checking the list of datanodes from the dfshealth page. Using default ports, for me it was:

<<mynamenode>>:50070/dfshealth.html#tab-datanode

That would list the datanodes and their status (active, decomissioned, space, etc...)

Also note that recent versions of Ambari will give that link under HDFS Summary "Quick Links" dropdown (its called "Namenode UI")