Created 05-11-2017 11:06 PM
Hi,
When i delete files from hdfs and even .Trash , In datanodes /dfs/dn directory not cleaning up blocks and resulting disk full in OS level storage. When i restart HDFS, some blocks/recent data blocks are missing frequently
dfs direcory usage in datanodes
# du -sh *
705G dfs
16K lost+found
hdfs usage
# sudo -u hdfs hdfs dfs -du -s -h /
270.3 G 812.7 G /
Please help me out....
Thanks in advance
Created 05-12-2017 08:04 AM
This is not an actual answer.... but try rebalance before you get block usage once again, it may help you
Created 05-14-2017 10:06 PM
Created 05-15-2017 02:39 AM
Hey @Harsh J, Please have a look at this topic