What are the best practices for replicating HDFS and Hive data between clusters?

[#1]

What are the best tools available for DAta replication and their best practices?

Thanks in advance.

[#2 · Accepted solution]

Cloudera offers Backup and Disaster Recovery (BDR) features as part of its enterprise offering that can do HDFS replication to other clusters, Hive metadata and data replication to other clusters, and also HBase snapshot backups to S3.

This is documented in detail at https://www.cloudera.com/documentation/enterprise/latest/topics/cm_bdr_about.html

Outside of this you can try to use DistCp for HDFS replication but for Hive replication you will need to manually propagate DDL-associated metadata.