Support Questions
Find answers, ask questions, and share your expertise

Blocks are not deleting in datanodes /dfs/dn dir when files deleted from HDFS

Blocks are not deleting in datanodes /dfs/dn dir when files deleted from HDFS

Contributor

Hi,

 

When i delete files from hdfs and even  .Trash , In datanodes /dfs/dn directory not cleaning up blocks and resulting disk full in OS level storage. When i restart HDFS, some blocks/recent data blocks are missing frequently

 

dfs direcory usage in datanodes

# du -sh *
705G dfs
16K lost+found

hdfs usage 

# sudo -u hdfs hdfs dfs -du -s -h /
270.3 G 812.7 G /

dfsuse.JPG

 

Please help me out....

Thanks in advance

3 REPLIES 3
Highlighted

Re: Blocks are not deleting in datanodes /dfs/dn dir when files deleted from HDFS

Champion

@RakeshE

 

This is not an actual answer.... but try rebalance before you get block usage once again, it may help you

 

 

 

 

Highlighted

Re: Blocks are not deleting in datanodes /dfs/dn dir when files deleted from HDFS

Contributor
I've already tried, but no use
Highlighted

Re: Blocks are not deleting in datanodes /dfs/dn dir when files deleted from HDFS

Contributor

Hey @Harsh J, Please have a look at this topic