Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Initiating HBase replication

Initiating HBase replication

Contributor

dear all.

 

I'm trying to initiate replication.

My situation is same as below.

https://www.cloudera.com/documentation/enterprise/5-13-x/topics/cdh_bdr_hbase_replication.html#topic...

 

  1. Start replication.
  2. Add the destination cluster as a peer and immediately disable it using disable_peer.
  3. On the source cluster, take a snapshot of the table and export it. The snapshot command flushes the table from memory for you.
  4. On the destination cluster, import and restore the snapshot.
  5. Run enable_peer to re-enable the destination cluster.

Source cluster has 40TB of table and to export snapshot to target cluster it will take 15 hours.

Is the changes (wal or replication queue) for this 15 hours will not be deleted?

 
Thanks.
1 REPLY 1

Re: Initiating HBase replication

Master Guru
Yes, it is indicated in the same document:

"""
Use the command disable_peer ("<peerID>") to disable replication for a specific peer. This will stop replication to the peer, but the logs will be kept for future reference.

Note: This log accumulation is a powerful side effect of the disable_peer command and can be used to your advantage. See Initiating Replication When Data Already Exists.
""" - https://www.cloudera.com/documentation/enterprise/latest/topics/cdh_bdr_hbase_replication.html#topic...
Don't have an account?
Coming from Hortonworks? Activate your account here