Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Export/Import HDFS snapshots

Solved Go to solution
Highlighted

Export/Import HDFS snapshots

New Contributor

Hi

Is it possible to copy HDFS snapshots to another cluster and use them (via distCP for instance)? What does this add compared to copy data directly (not snapshots) via distCP for DR?

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Export/Import HDFS snapshots

Hi @Houssam Manik,

The big benefit that you get by utilizing snapshots with distCP is that you can do incremental backups when distCP'ing the snapshotted directory in the future by leveraging the differential between the snapshots. Jing provides some context around this in the second answer here. The work to complete this is discussed in HDFS-7535 and some more context is provided there. This was first pulled into Hadoop 2.7.0

1 REPLY 1

Re: Export/Import HDFS snapshots

Hi @Houssam Manik,

The big benefit that you get by utilizing snapshots with distCP is that you can do incremental backups when distCP'ing the snapshotted directory in the future by leveraging the differential between the snapshots. Jing provides some context around this in the second answer here. The work to complete this is discussed in HDFS-7535 and some more context is provided there. This was first pulled into Hadoop 2.7.0

Don't have an account?
Coming from Hortonworks? Activate your account here