Falcon HDFS Mirror deletions

[#1]

Hi,

I set up a Falcon HDFS mirror. Inserts and file updates in the Src are handled just fine. Only deletions from the Src are not reflected in the Tgt. Is that a config thing or just not supported?

[#2 · Accepted solution]

@Jasper

Pass removeDeletedFiles property in the request. This maps to -delete option in DistCP. Thanks!

[#3]

@Sowmya Ramesh is there a hook for that in the Falcon WebUI? Is it that TAG > Value thing maybe

[#4]

Looks like this is not supported in UI. You can do a it through REST API or command line. Refer https://falcon.apache.org/restapi/ExtensionSubmitAndSchedule.html

or update existing mirror jobs using https://falcon.apache.org/restapi/ExtensionUpdate.html

Add "removeDeletedFiles=true" as POSt parameter. Thanks!