question HBase data migration from one cluster to other cluster in Archives of Support Questions (Read Only)

HBase data migration from one cluster to other cluster

dhirajk — Fri, 28 Sep 2018 02:22:08 GMT

Hi, Need help with HBase data migration from one cluster to other cluster. Please share the instructions or any proper articles.

Thanks.

Re: HBase data migration from one cluster to other cluster

amol_08 — Sat, 29 Sep 2018 13:59:43 GMT

Dhiraj

There are many method to achieve the same like copytable , import/export utility , snapshot . I would prefer snapshot method .But snapshot method will work if Hbase is of same version in both the cluster .If your both cluster hbase versions are different then you can use Copytable method.

snapshot method :

STEP 1: Go to hbase-shell and Take a snapshot of table

>hbase shell

>snapshot "SOURCE_TABLE_NAME","SNAPSHOT_TABLE_NAME"

Step 3 : Export that snapshot to other cluster

>bin/hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot SNAPSHOT_TABLE_NAME -copy-to hdfs://DESTINATION_CLUSTER_ACTIVE_NAMENODE_ADDRESS:8020/hbase -mappers 16

STEP 4: restore the table on DESTINATION Cluster :

>hbase shell

>disable "DEST_TABLENAME"

>restore_snapshot "SNAPSHOT_TABLE_NAME"

Re: HBase data migration from one cluster to other cluster

amol_08 — Sat, 29 Sep 2018 14:01:59 GMT

Please follow below link :

http://hbase.apache.org/0.94/book/ops_mgt.html#copytable

Re: HBase data migration from one cluster to other cluster

dhirajk — Sat, 27 Oct 2018 04:05:21 GMT

@Anurag Mishra

Thanks for the detailed steps, but will snapshot take cares of DDLs too? or do we need to take a DDL and create it manually in the destination cluster?

Thanks,

Dhiraj.

Re: HBase data migration from one cluster to other cluster

trent_larson — Sat, 20 Jun 2020 19:09:54 GMT

Which user do you need to be to execute these commands? I'm getting PermissionDenied Error. Please advise.

TIA

Re: HBase data migration from one cluster to other cluster

VidyaSargur — Mon, 22 Jun 2020 06:29:40 GMT

@trent_larson As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also provide the opportunity to provide details specific to your environment that could aid others in providing a more accurate answer to your question.