Support Questions
Find answers, ask questions, and share your expertise

Incremental backup with Falcon

I want to use Falcon for DR and copy data from cluster 1 to cluster 2. Can I do incremental backup ? it's not efficient to copy all data again and again. How Falcon know which data is new ?



Re: Incremental backup with Falcon

Rising Star

Currently, Falcon diffs the source and targets and then copies the partitions with differences. In HDP 2.5, HDFS snapshots will be available to improve efficiency. If you are using Hive, HiveDR works best for tables that have many small partitions versus tables that have fewer large partitions, since currently, any partition that is different is copied in it's entirety.