Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

how to check missing or corrupted blocks have successful replication in other nodes.

Highlighted

how to check missing or corrupted blocks have successful replication in other nodes.

New Contributor

how to check missing or corrupted blocks have successful replication in other nodes.

1 REPLY 1

Re: how to check missing or corrupted blocks have successful replication in other nodes.

Super Mentor

@Manoj Menon

You can use to determine which files are having problems.

hdfs fsck /
(OR)
hdfs fsck hdfs://ip.or.host:50070/ | egrep -v '^\.+$' | grep -v replica | grep -v Replica



More details can be found on the following link to see how to deal with "Corrupted Blocks".

https://www.centoshowtos.org/hadoop/fix-corrupt-blocks-on-hdfs/

https://stackoverflow.com/questions/19205057/how-to-fix-corrupt-hdfs-files

https://community.hortonworks.com/questions/50598/how-to-remove-corrupted-blocks-from-hdfs.html

.


Similarly if you see some "Under replicated Blocks" as well on your cluster then you can refer to the approach mentioned in the following HCC article to deal with it:


https://community.hortonworks.com/articles/4427/fix-under-replicated-blocks-in-hdfs-manually.html

.

Don't have an account?
Coming from Hortonworks? Activate your account here