Support Questions

Find answers, ask questions, and share your expertise

HDFS

avatar
Explorer

I have removed files from HDFS by skipping trash but still it shows same disk useage

1 ACCEPTED SOLUTION

avatar
Contributor

How much data did you delete ? Did checkpoint happen after you deleted data ? Also please check if any snapshots are present ? HDFS CLI "du" output not only include normal files but also includes the files that have been deleted and exist in snapshots (which is true in terms of real resource consumption).

 

Please check the output using -x flag which excludes snapshot from calculation.

 

hdfs dfs -du -x -s -h /path

 

 

View solution in original post

1 REPLY 1

avatar
Contributor

How much data did you delete ? Did checkpoint happen after you deleted data ? Also please check if any snapshots are present ? HDFS CLI "du" output not only include normal files but also includes the files that have been deleted and exist in snapshots (which is true in terms of real resource consumption).

 

Please check the output using -x flag which excludes snapshot from calculation.

 

hdfs dfs -du -x -s -h /path