question BDR in CDH 6.3 - are deletes replicated as well? in Support Questions

BDR in CDH 6.3 - are deletes replicated as well?

rajatsachan — Fri, 16 Sep 2022 14:40:47 GMT

Hi all,

I am curious to know if the BDR schedules sync deletes as well? Meaning, if some files are deleted from the source, will the next BDR run delete those files from the destination as well to make the source and destination exact copies?

Thanks!

Re: BDR in CDH 6.3 - are deletes replicated as well?

tjangid — Mon, 22 Feb 2021 10:22:56 GMT

Hello @rajatsachan,

Using the Delete Policy, you may set up any of the below options

Delete Policy - Whether files that were deleted on the source should also be deleted from the destination directory. This policy also determines the handling of files in the destination location that are unrelated to the source. Options include:

Keep Deleted Files - Retains the destination files even when they no longer exist at the source. (This is the default.).
Delete to Trash - If the HDFS trash is enabled, files are moved to the trash folder. (Not supported when replicating to Amazon S3.)
Delete Permanently - Uses the least amount of space; use with caution.

Review the replication document for more details:

https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_bdr_hdfs_replication.html

Cheers!

Re: BDR in CDH 6.3 - are deletes replicated as well?

rajatsachan — Mon, 22 Feb 2021 10:25:07 GMT

Thank you so much @tjangid . This surely clarifies my doubts.