Created 04-14-2016 02:08 PM
I don't think 5.7 has that.
I think the chance to interrupt a running distcp is rare. And even with that, you can still use distcp to safely copy except it might take a much longer time to finish than the snapshot way. If you can accept that, it is still a good option.
Created 05-25-2016 08:02 PM
Hello Yufei,
Do we have an ETA for the snapshot rollback availability? How do you think it will solve our issue?
Created on 05-26-2016 04:55 PM - edited 05-26-2016 04:57 PM
No earlier than cdh-5.9 as far as I know. If it is available, it can solve the issue.
Created 12-06-2016 05:47 AM
Hello,
CDH 5.9 finally doesn't support distcp snapshot rollback
Could you tell us which CDH version is going to support it ?
Thank you
Vladi
Created 12-06-2016 09:52 AM
HDFS-9820 is in CDH-5.9.1 and later versions.
Created 07-30-2016 08:59 AM
Hi,
Do you think using -atomic and save the temp file outside the snaphotable directory can help in such case?
Hope the rollback snapshot feature will be available in 5.9.
Created 07-09-2016 09:04 AM
Do you think using -atomic=true will solve the issue?
i'm still not sure what is the cause that it's lists all source files, but i'm thinking since the destination folder has been changed since some mappers finish and commit, i'm thinking if using the -atomic and keeping the temp folder out of the destination folder should solve the issue.
Created 12-06-2016 10:03 AM
Created 12-06-2016 10:25 AM
Nope. It also gonna be in CDH-5.5.6, CDH-5.7.6 and CDH-5.8.4.
Created 01-25-2017 08:28 PM