How to replicate all hive ddl and database from one cluster to cloud cluster?

[#1]

Hey @Ashnee Sharma

Please refer this - https://community.hortonworks.com/questions/4496/how-to-migrate-hive-data-over-to-new-cluster.html

[#2]

@Ashnee Sharma : Did @Kuldeep Kulkarni's response answer your question? If yes, please accept the answer

[#3]

@Ashnee Sharma

Look into this http://falcon.apache.org/Recipes.html

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_data_governance/content/section_mirroring...

[#4 · Accepted solution]

For migrating a hive installation, I did the following things.

1) Install hive in the new hadoop cluster.

2) Transfer the data present in the hive metastore directory (i.e /user/hive/warehouse) to the new hadoop cluster 3) taken the mysql metastore dump. 4) Install mysql in the new hadoop cluster 5) Open the hive mysql-metastore dump using text readers such as notepad, notepad++ etc and search for hdfs://ip-address-old-namenode:port and replace with hdfs://ip-address-new-namenode:port and save it.

Where ip-address-old-namenode is the ipaddress of namenode of old hadoop cluster and ip-address- new-namenode is the ipaddress of namenode of new hadoop cluster.

6) After doing the above steps, restore the editted mysql dump into the mysql of new hadoop cluster. 7) Configure hive as normal and do the hive schema upgradations if needed.

This is a solution that I discovered when I faced the migration issues. I dont know whether any other

standard methods are available.

This worked for me perfectly. 🙂

[#5]

@Ashnee Sharma -

are you still having issues with this? Can you accept best answer or provide your own solution?