Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HDFS-HAWQ - Migration to New Hardware

Highlighted

HDFS-HAWQ - Migration to New Hardware

New Contributor

We have version PHD3.0 hadoop cluster for 5 node using ambari on rackspace . We have to migrate into Google cloud (GCP).

But Not getting

How do i migrate data,metadata configuration from Old machine to New machine. ( Old Machine version is centos 6.5 to New machine version centos 7)

What components and folders to backup? What would be the commands?

How to backup namode and datanodes ?

Do we need to take backup of ambari database also ?

Any help on it would be much appreciated ?

4 REPLIES 4

Re: HDFS-HAWQ - Migration to New Hardware

New Contributor

Hello,

What is the target PHD/HDP version and Hawq version planning to migrate on to GCP ? Just noting, Hawq/HDB 2.x is not supported on Cent OS 7. Assuming the target PHD/HDB and OS are all on supported versions. Here are the high level steps that may have to consider to migrate to GCP.

1. Install and Configure the supported version of PHD/HDP

2. Migrate the HDFS data other than the Hawq data to new cluster and including on other PHD components if any.

3. Depending the source data size, you may consider either of the methods such as the below to offload the source hawq data

1) PG dump

2) Gpfdist

3) Hawq's PXF approach

4. Re-load the hawq data on to new cluster

Once all data is migrated, you may shutdown the old cluster.

Re: HDFS-HAWQ - Migration to New Hardware

New Contributor

Thanks for reply. please consider everything on centos 6.5 instead 7.

2. Migrate the HDFS data other than the Hawq data to new cluster and including on other PHD components if any.

can we have hadoop backup data,metadata,config commands?

Note : Trying to Install through ambari.on old machine we have ambari 1.7 version.

For hawq

we will use pg_dump/restore for sure.

Re: HDFS-HAWQ - Migration to New Hardware

New Contributor

Target PHD version is 3.0.1.

Re: HDFS-HAWQ - Migration to New Hardware

Contributor

Hi Vij, please keep in mind that PHD 3.0.x is supported till 2017-04-30 only, and you may want to start thinking about long-term migration to HDP. See: https://pivotal.io/support/lifecycle_policy

Don't have an account?
Coming from Hortonworks? Activate your account here