Posts: 43
Registered: ‎03-19-2018

Non DFS Utilization shows same post cleanup of local filesystem

Initially when the environment was built there were around 327.33 GB out of total 1 TB Disk Capacity

Hence the HDFS dfsadmin report showed non-dfs usage as 327.33 GB 


But after cleaning up of 300GB of on data from the Fileystem , dfsadmin report still show the non-dfs usage as 327.33 GB itself , while the reserved diskspace is 10GB


how could i get the Non-DFS utilisation refreshed post clean-up of local files on Linux Filesystem ?


hdfs dfsadmin -report


Name: (
Rack: /Row7/Rack2
Decommission Status : Normal
Configured Capacity: 1154570731520 (1.05 TB)
DFS Used: 449671168 (428.84 MB)
Non DFS Used: 351465279488 (327.33 GB)
DFS Remaining: 802655780864 (747.53 GB)
DFS Used%: 0.04%
DFS Remaining%: 69.52%
Configured Cache Capacity: 4294967296 (4 GB)
Cache Used: 0 (0 B)
Cache Remaining: 4294967296 (4 GB)
Cache Used%: 0.00%
Cache Remaining%: 100.00%
Xceivers: 2
Last contact: Thu Apr 12 08:18:16 PDT 2018

Expert Contributor
Posts: 361
Registered: ‎01-25-2017

Re: Non DFS Utilization shows same post cleanup of local filesystem

@Johnny_Bach Try deleting logs from your local nodes and see if that make some space, look for yarn.nodemanager.local-dirs parameter location.


Our community is getting a little larger. And a lot better.

Learn More about the Cloudera and Hortonworks community merger planned for late July and early August.