Created 11-05-2017 08:21 AM
how to check missing or corrupted blocks have successful replication in other nodes.
Created 11-05-2017 08:45 AM
@Manoj Menon
You can use to determine which files are having problems.
hdfs fsck / (OR) hdfs fsck hdfs://ip.or.host:50070/ | egrep -v '^\.+$' | grep -v replica | grep -v Replica
More details can be found on the following link to see how to deal with "Corrupted Blocks".
https://www.centoshowtos.org/hadoop/fix-corrupt-blocks-on-hdfs/
https://stackoverflow.com/questions/19205057/how-to-fix-corrupt-hdfs-files
https://community.hortonworks.com/questions/50598/how-to-remove-corrupted-blocks-from-hdfs.html
.
Similarly if you see some "Under replicated Blocks" as well on your cluster then you can refer to the approach mentioned in the following HCC article to deal with it:
https://community.hortonworks.com/articles/4427/fix-under-replicated-blocks-in-hdfs-manually.html