question Re: how to backup hive tables ? in Archives of Support Questions (Read Only)

how to backup hive tables ?

npawar — Wed, 22 Mar 2017 21:29:02 GMT

Hi,

I have cluster of 24 nodes. I want to take backup of multiple hive tables and wanted to migrate over another cluster having 3 nodes. can anyone tell me the best way.

Re: how to backup hive tables ?

egarelnabi — Wed, 22 Mar 2017 22:02:28 GMT

@Nikhil Pawar

1) Stop Hive on the target cluster

2) Distcp all the necessary files on HDFS to the secondary cluster.

3) Take a SQL dump of your Hive Metastore (which is in MySQL or Postgres).

4) Restore the SQL dump on your target cluster.

5) Use the Hive Metatool "-updateLocation" command on the target cluster to change the Metastore URIs

https://cwiki.apache.org/confluence/display/Hive/Hive+MetaTool

6) Start Hive on the target cluster

To make the process easier, assuming this is a one-time thing, I suggest that you copy the entire Metastore rather than trying to pick and choose certain tables. While being selective is possible, it will add a bit more complexity to your process.

Re: how to backup hive tables ?

npawar — Wed, 22 Mar 2017 22:12:01 GMT

thanks eyad.. i will check with this. thanks again

Re: how to backup hive tables ?

namaheshwari — Thu, 23 Mar 2017 01:01:37 GMT

Below posts also talks about Backing up Hive tables:

https://community.hortonworks.com/questions/394/what-are-best-practices-for-setting-up-backup-and.html

https://community.hortonworks.com/questions/78292/backup-specific-hive-table.html