Support Questions
Find answers, ask questions, and share your expertise

Migrate DB from Hive 1.2 to Hive 3.1

Explorer

Greetings to the community. I have this problem.

*SOURCE PLATFORM::

HDP 2.6.5 Hive 1.2.1000

 

*DESTINATION PLATFORM::

-CDP Private Cloud Base 7.1.5

Hive 3.1.3000.7.1.5.0-257

 

I need migrate any DataBase from Hive 1.2 to Hive 3.1 How can I do this work?, What I need to do?

 

Thank you for the support you can give me

6 REPLIES 6

Mentor

@vciampa 

Please look at this document that performs the steps for upgrading from HDP to CDP Private 

Happy hadooping

Rising Star

Hi @vciampa 

 

Please check the below document which should help you to understand the requirement upgrading from HDP 2. X to CDP 7.X cluster as well as Hive.

 

https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/upgrade-hdp/topics/amb-hdp-cdp-upg.html

https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/upgrade-hdp/topics/ug_hive_validations.ht...

https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/upgrade-cdh/topics/ug_hive_changes_in_cdp...

 

If you are happy with the comment, Mark it "Accept as Solution".

Explorer

Thanks for your links!

I want to explain the situation better:
1) The CDP Private Cloud Base 7.1.5 platform is already installed
2) In this platform (the new one) Hive 3.1 is installed (Here I need to place the databases that are in version 1.2 Hive)
3) There is another HDP platform, the old one that has Hive 1.2 databases
4) The new CDP-PvCB platform has kerberos and TLS / SSL enabled

The goal is to move the databases from Hive 1.2 (previous platform) to the new platform that has Hive 3.1

 

Some other document or application to perform this task

Thanks for your support!

 

Mentor

@vciampa 
The solution is the Replication Manager which enables you to replicate data across data centers for disaster recovery scenarios. Replication Manager replicates HDFS, Hive, and Impala data, and supports Sentry to Ranger replication from CDH (version 5.10 and higher) clusters to CDP Private Cloud Base (version 7.0. 3 and higher) clusters.
https://docs.cloudera.com/cdp/latest/data-migration/topics/cdp-data-migration-replication-manager-to...
It's easy to use 🙂
Happy Hadooping 

 

Explorer

Thanks @Shelton.
Reading I found these limitations:
- Replicating to and from HDP to Cloudera Manager 7.x is not supported by Replication Manager.
* The only option I saw:
- Use DistCp to replicate data.
- Hive external tables. For information to replicate data, contact Cloudera Support =>?
https://docs.cloudera.com/cdp/latest/data-migration/topics/cdpdc-compatibility-matrix-bdr.html

Explorer

@Shelton, Thanks for your links, they are helpful.

I want to explain the situation better:
1) The CDP Private Cloud Base 7.1.5 platform is already installed.
2) In this platform (the new one) Hive 3.1 is installed (Here I need to place the databases that are in version 1.2 Hive)
3) There is another HDP platform, the old one that has Hive 1.2 databases
4) The new CDP-PvCB platform has kerberos and TLS / SSL enabled

 

The goal is to move the databases from Hive 1.2 (previous platform) to the new platform that has Hive 3.1

Thanks for you support!