Reply
Explorer
Posts: 28
Registered: ‎07-15-2015

Blocks are not deleting in datanodes /dfs/dn dir when files deleted from HDFS

Hi,

 

When i delete files from hdfs and even  .Trash , In datanodes /dfs/dn directory not cleaning up blocks and resulting disk full in OS level storage. When i restart HDFS, some blocks/recent data blocks are missing frequently

 

dfs direcory usage in datanodes

# du -sh *
705G dfs
16K lost+found

hdfs usage 

# sudo -u hdfs hdfs dfs -du -s -h /
270.3 G 812.7 G /

dfsuse.JPG

 

Please help me out....

Thanks in advance

Posts: 352
Topics: 11
Kudos: 54
Solutions: 30
Registered: ‎09-02-2016

Re: Blocks are not deleting in datanodes /dfs/dn dir when files deleted from HDFS

@RakeshE

 

This is not an actual answer.... but try rebalance before you get block usage once again, it may help you

 

 

 

 

Explorer
Posts: 28
Registered: ‎07-15-2015

Re: Blocks are not deleting in datanodes /dfs/dn dir when files deleted from HDFS

I've already tried, but no use
Highlighted
Explorer
Posts: 28
Registered: ‎07-15-2015

Re: Blocks are not deleting in datanodes /dfs/dn dir when files deleted from HDFS

Hey @Harsh J, Please have a look at this topic

Announcements