Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Migrate DB from Hive 1.2 to Hive 3.1

avatar
Contributor

Greetings to the community. I have this problem.

*SOURCE PLATFORM::

HDP 2.6.5 Hive 1.2.1000

 

*DESTINATION PLATFORM::

-CDP Private Cloud Base 7.1.5

Hive 3.1.3000.7.1.5.0-257

 

I need migrate any DataBase from Hive 1.2 to Hive 3.1 How can I do this work?, What I need to do?

 

Thank you for the support you can give me

6 REPLIES 6

avatar
Master Mentor

@vciampa 

Please look at this document that performs the steps for upgrading from HDP to CDP Private 

Happy hadooping

avatar
Expert Contributor

Hi @vciampa 

 

Please check the below document which should help you to understand the requirement upgrading from HDP 2. X to CDP 7.X cluster as well as Hive.

 

https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/upgrade-hdp/topics/amb-hdp-cdp-upg.html

https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/upgrade-hdp/topics/ug_hive_validations.ht...

https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/upgrade-cdh/topics/ug_hive_changes_in_cdp...

 

If you are happy with the comment, Mark it "Accept as Solution".

avatar
Contributor

Thanks for your links!

I want to explain the situation better:
1) The CDP Private Cloud Base 7.1.5 platform is already installed
2) In this platform (the new one) Hive 3.1 is installed (Here I need to place the databases that are in version 1.2 Hive)
3) There is another HDP platform, the old one that has Hive 1.2 databases
4) The new CDP-PvCB platform has kerberos and TLS / SSL enabled

The goal is to move the databases from Hive 1.2 (previous platform) to the new platform that has Hive 3.1

 

Some other document or application to perform this task

Thanks for your support!

 

avatar
Master Mentor

@vciampa 
The solution is the Replication Manager which enables you to replicate data across data centers for disaster recovery scenarios. Replication Manager replicates HDFS, Hive, and Impala data, and supports Sentry to Ranger replication from CDH (version 5.10 and higher) clusters to CDP Private Cloud Base (version 7.0. 3 and higher) clusters.
https://docs.cloudera.com/cdp/latest/data-migration/topics/cdp-data-migration-replication-manager-to...
It's easy to use 🙂
Happy Hadooping 

 

avatar
Contributor

Thanks @Shelton.
Reading I found these limitations:
- Replicating to and from HDP to Cloudera Manager 7.x is not supported by Replication Manager.
* The only option I saw:
- Use DistCp to replicate data.
- Hive external tables. For information to replicate data, contact Cloudera Support =>?
https://docs.cloudera.com/cdp/latest/data-migration/topics/cdpdc-compatibility-matrix-bdr.html

avatar
Contributor

@Shelton, Thanks for your links, they are helpful.

I want to explain the situation better:
1) The CDP Private Cloud Base 7.1.5 platform is already installed.
2) In this platform (the new one) Hive 3.1 is installed (Here I need to place the databases that are in version 1.2 Hive)
3) There is another HDP platform, the old one that has Hive 1.2 databases
4) The new CDP-PvCB platform has kerberos and TLS / SSL enabled

 

The goal is to move the databases from Hive 1.2 (previous platform) to the new platform that has Hive 3.1

Thanks for you support!