Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Prune namenode metadata

avatar
Master Guru

I am interested in pruning entries manually from the name node. If orphan entries exist in namenode (where namenode thinks file exist when it does not) how do I manually remove from namenode metadatea?

1 ACCEPTED SOLUTION

avatar
Master Guru

Use fsck, it's a tool of choice to manage HDFS. "Orphans" are corrupted files (with missing blocks) in HDFS lingo. You can use "-move" or "-delete" options to move corrupted files to /lost+found or to delete them. fsck will also tell you about under-replicated blocks (having at least 1 replica but less than configured replication factor) but HDFS will repair them little by little by creating missing replicas.

View solution in original post

1 REPLY 1

avatar
Master Guru

Use fsck, it's a tool of choice to manage HDFS. "Orphans" are corrupted files (with missing blocks) in HDFS lingo. You can use "-move" or "-delete" options to move corrupted files to /lost+found or to delete them. fsck will also tell you about under-replicated blocks (having at least 1 replica but less than configured replication factor) but HDFS will repair them little by little by creating missing replicas.