Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How can i do two mirrow cluster?

How can i do two mirrow cluster?

Explorer

Hi all 

 

I need to create 2 Clusters (2 NameNodes and 4 DataNodes for example),and both of them need to be exactly (for example copie all the information betwee the cluster 1 to the  cluster 2 each 30 minutes) exist any development about that or mechanism?

 

Best regards

2 REPLIES 2

Re: How can i do two mirrow cluster?

Master Guru
You can use CM's API features to deploy clusters with identical configurations. See http://cloudera.github.io/cm_api/ and https://github.com/gdgt/cmapi for an example script based on the API (via Python bindings).

Re: How can i do two mirrow cluster?

Master Guru
For the copy requirement, Cloudera Enterprise provides a Backup and Disaster Recovery feature that can replicate HDFS and Hive data+metadata between two clusters: http://www.cloudera.com/content/cloudera/en/resources/library/training/cloudera-enterprise-bdr-overv...

You could also alternatively use DistCp for just HDFS data.