Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

how to recover missing blocks of hdfs after delete a data dir in the datanode by a mistake

Solved Go to solution
Highlighted

how to recover missing blocks of hdfs after delete a data dir in the datanode by a mistake

Explorer

There was a blunder we have deleted a data directory by using skipTrash command also.

The volume to data which we lost was huge.   

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: how to recover missing blocks of hdfs after delete a data dir in the datanode by a mistake

Master Guru
I'm afraid there's no easy way to recover out of this if you've not taken HDFS snapshots prior to this either.

If you've stopped the entire cluster immediately to prevent further disk usage, you can perhaps try to run ext-level disk recovery tools to recover the deleted blocks, and then rollback your NN to start from the pre-deletes checkpoint, and that may give back some fraction of your data.

View solution in original post

1 REPLY 1
Highlighted

Re: how to recover missing blocks of hdfs after delete a data dir in the datanode by a mistake

Master Guru
I'm afraid there's no easy way to recover out of this if you've not taken HDFS snapshots prior to this either.

If you've stopped the entire cluster immediately to prevent further disk usage, you can perhaps try to run ext-level disk recovery tools to recover the deleted blocks, and then rollback your NN to start from the pre-deletes checkpoint, and that may give back some fraction of your data.

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here