question Re: Remaining capacity of HDFS : 0 in Archives of Support Questions (Read Only)

Remaining capacity of HDFS : 0

dvt_isoft — Mon, 03 Jul 2017 23:37:27 GMT

Hi,

I am facing an alert while starting my services on ambari : HDFS tells me that it has no more disk space available, even though I haven't right anything on HDFS yet.

The alert is the following :

Capacity Used:[100%, 36864], Capacity Remaining:[0]

The thing is that I have set 300000000000 bytes of capacity for HDFS (property "Reserved space for HDFS"), so I can't see where my problem is ...

Thanks in advance for your answer !

Sylvain.

Re: Remaining capacity of HDFS : 0

vasubramanian — Tue, 04 Jul 2017 13:36:19 GMT

@Sylvain:

Configured capacity of HDFS is calculated as

Configured Capacity = Total Disk Space - Reserved Space

Reserved space is the space which is allocated for OS level operations and set using the parameter dfs.datanode.du.reserved .

Can you please let me know whats the total disk space in your scenario? Also is there any specific reason why dfs.datanode.du.reserved is set to a huge value?

Re: Remaining capacity of HDFS : 0

dvt_isoft — Wed, 12 Jul 2017 23:26:35 GMT

Thanks. I was just misunderstanding the meaning of the property "Reserved space for HDFS". I actually thought it was the disk space we set for file storage ...