Welcome to the Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

Non-DFS space issue in CDH-5

avatar
Explorer

Hi,

PFB a sample snapshot from the Name Node UI.

 

The Non-DFS used is showing such a huge value, but there are no files, logs etc in the hadoop directories (dfs.data.dir or dfs.datanode.data.dir).

 

So where does this data come from?

 

And, for example, the total space in the node that I use (example Node 2.com) is itself 520 GB and the space allocated to the hadoop directory(dfs.data.dir ) is 420 GB. So from where does the values 1.27 TB and 886.14 GB come from?

 

Please clarify and let me know how this could be resolved. Thanks!

Name Last contact Admin State Capacity Used Non DFS Used Remaining Blocks Block pool used

1.com       2      In Service        265.76 GB   260.83 GB     0 B              4.94 GB    17973         260.83 GB 
2.com       1      In Service        1.27 TB      396.57 GB    886.14 GB      16.58 GB   28148         396.57 GB 
3.com       0      In Service        1.27 TB      384.71 GB    854.03 GB      60.55 GB   23165         384.71 GB 
4.com 0 In Service 265.76 GB 228.84 GB 0 B 36.92 GB 5117 228.84 GB 5.com 1 In Service 1.27 TB 258.88 GB 1020.93 GB 19.47 GB 20679 258.88 GB

 

 

Who agreed with this topic