Support Questions
Find answers, ask questions, and share your expertise

how to check missing or corrupted blocks have successful replication in other nodes.

New Contributor

how to check missing or corrupted blocks have successful replication in other nodes.

1 REPLY 1

Super Mentor

@Manoj Menon

You can use to determine which files are having problems.

hdfs fsck /
(OR)
hdfs fsck hdfs://ip.or.host:50070/ | egrep -v '^\.+$' | grep -v replica | grep -v Replica



More details can be found on the following link to see how to deal with "Corrupted Blocks".

https://www.centoshowtos.org/hadoop/fix-corrupt-blocks-on-hdfs/

https://stackoverflow.com/questions/19205057/how-to-fix-corrupt-hdfs-files

https://community.hortonworks.com/questions/50598/how-to-remove-corrupted-blocks-from-hdfs.html

.


Similarly if you see some "Under replicated Blocks" as well on your cluster then you can refer to the approach mentioned in the following HCC article to deal with it:


https://community.hortonworks.com/articles/4427/fix-under-replicated-blocks-in-hdfs-manually.html

.