Reply
Explorer
Posts: 11
Registered: ‎07-16-2015

How can i do two mirrow cluster?

Hi all 

 

I need to create 2 Clusters (2 NameNodes and 4 DataNodes for example),and both of them need to be exactly (for example copie all the information betwee the cluster 1 to the  cluster 2 each 30 minutes) exist any development about that or mechanism?

 

Best regards

Posts: 1,886
Kudos: 425
Solutions: 300
Registered: ‎07-31-2013

Re: How can i do two mirrow cluster?

You can use CM's API features to deploy clusters with identical configurations. See http://cloudera.github.io/cm_api/ and https://github.com/gdgt/cmapi for an example script based on the API (via Python bindings).
Posts: 1,886
Kudos: 425
Solutions: 300
Registered: ‎07-31-2013

Re: How can i do two mirrow cluster?

For the copy requirement, Cloudera Enterprise provides a Backup and Disaster Recovery feature that can replicate HDFS and Hive data+metadata between two clusters: http://www.cloudera.com/content/cloudera/en/resources/library/training/cloudera-enterprise-bdr-overv...

You could also alternatively use DistCp for just HDFS data.