- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Non DFS Utilization shows same post cleanup of local filesystem
- Labels:
-
Apache Hadoop
Created ‎04-12-2018 03:32 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Initially when the environment was built there were around 327.33 GB out of total 1 TB Disk Capacity
Hence the HDFS dfsadmin report showed non-dfs usage as 327.33 GB
But after cleaning up of 300GB of on data from the Fileystem , dfsadmin report still show the non-dfs usage as 327.33 GB itself , while the reserved diskspace is 10GB
how could i get the Non-DFS utilisation refreshed post clean-up of local files on Linux Filesystem ?
hdfs dfsadmin -report
Name: 20.21.208.21:2004 (hpc123.xyz.com)
Hostname:hpc123.xyz.com
Rack: /Row7/Rack2
Decommission Status : Normal
Configured Capacity: 1154570731520 (1.05 TB)
DFS Used: 449671168 (428.84 MB)
Non DFS Used: 351465279488 (327.33 GB)
DFS Remaining: 802655780864 (747.53 GB)
DFS Used%: 0.04%
DFS Remaining%: 69.52%
Configured Cache Capacity: 4294967296 (4 GB)
Cache Used: 0 (0 B)
Cache Remaining: 4294967296 (4 GB)
Cache Used%: 0.00%
Cache Remaining%: 100.00%
Xceivers: 2
Last contact: Thu Apr 12 08:18:16 PDT 2018
Created ‎04-13-2018 11:36 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Have you clean up files under dfs.datanode.data.dirs that is not being written by HDFS for blocks? If not, the non-dfs used won't change.
Similar question has been answered here: https://community.hortonworks.com/questions/42122/hdfs-non-dfs-used.html.
Created ‎04-13-2018 11:36 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Have you clean up files under dfs.datanode.data.dirs that is not being written by HDFS for blocks? If not, the non-dfs used won't change.
Similar question has been answered here: https://community.hortonworks.com/questions/42122/hdfs-non-dfs-used.html.
