Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

DR/replication strategy using distcp + Oozie

avatar

Can someone please share how to use distcp+oozie (not Falcon) for cluster DR/replication.

My understanding is that the entire distcp job will fail if any file in the path is being written to, and the best way around that would be to do the distcp against snapshots. But what is the entire end to end process?

Also, what checks can be done on the DR cluster to ensure the success of the job and that the data is synced with the metastore?

1 ACCEPTED SOLUTION

avatar
Expert Contributor
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
4 REPLIES 4

avatar
Expert Contributor
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login

avatar
Expert Contributor

the links seem to be showing now, if you still can't see them pm me and I'll send them to you directly

avatar
Expert Contributor

Although I have described the process of DIY, Falcon does support snapshots and does you distcp underneath is all... this should be mentioned even though you asked for a work around Falcon.

avatar
Expert Contributor