Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

BDR in CDH 6.3 - are deletes replicated as well?

avatar
Explorer

Hi all,

I am curious to know if the BDR schedules sync deletes as well? Meaning, if some files are deleted from the source, will the next BDR run delete those files from the destination as well to make the source and destination exact copies?

Thanks!

1 ACCEPTED SOLUTION

avatar
Expert Contributor

Hello @rajatsachan,

Using the Delete Policy, you may set up any of the below options

Delete Policy - Whether files that were deleted on the source should also be deleted from the destination directory. This policy also determines the handling of files in the destination location that are unrelated to the source. Options include:

  • Keep Deleted Files - Retains the destination files even when they no longer exist at the source. (This is the default.).
  • Delete to Trash - If the HDFS trash is enabled, files are moved to the trash folder. (Not supported when replicating to Amazon S3.)
  • Delete Permanently - Uses the least amount of space; use with caution.

 

Review the replication document for more details:

https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_bdr_hdfs_replication.html

 

Cheers!

View solution in original post

2 REPLIES 2

avatar
Expert Contributor

Hello @rajatsachan,

Using the Delete Policy, you may set up any of the below options

Delete Policy - Whether files that were deleted on the source should also be deleted from the destination directory. This policy also determines the handling of files in the destination location that are unrelated to the source. Options include:

  • Keep Deleted Files - Retains the destination files even when they no longer exist at the source. (This is the default.).
  • Delete to Trash - If the HDFS trash is enabled, files are moved to the trash folder. (Not supported when replicating to Amazon S3.)
  • Delete Permanently - Uses the least amount of space; use with caution.

 

Review the replication document for more details:

https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_bdr_hdfs_replication.html

 

Cheers!

avatar
Explorer

Thank you so much @tjangid . This surely clarifies my doubts.