Reply
ujj
Explorer
Posts: 7
Registered: ‎05-16-2016
Accepted Solution

Clusters in multiple regions managed single Manager/Director

Wondering what is the design guidance for setting up clusters in different AWS Regions. Is it recommended to have a local Manager/Director in each region or have a central one and have the other regions talk to that central Manager/Director?

Cloudera Employee
Posts: 52
Registered: ‎10-28-2014

Re: Clusters in multiple regions managed single Manager/Director

A single Cloudera Director instance can have multiple environments, potentially spanning multiple cloud providers or regions. Each environment is configured with a specific cloud provider and region. A single environment can have multiple deployments, each corresponding to a single Cloudera Manager instance. Each Cloudera Manager instance can manage multiple clusters.

 

The only requirement is that Cloudera Director can reach the hosts it creates via SSH. If you use Cloudera Director to manage clusters within a single region, you can potentially have all communication be on the private IP addresses of the instances. If you use Cloudera Director to manage clusters in a different cloud provider or region, you will either have to do special networking (e.g. VPN) to gain access to the private IP addresses, or you will have to permit SSH access on the public IP address, which has security implications.

 

New Contributor
Posts: 1
Registered: ‎11-21-2017

Re: Clusters in multiple regions managed single Manager/Director

We are having a cluster in Azure US region and we are going to build a new hadoop cluster in EU region. We are planning to install this new cluster(EU region) using same same cloudera manager server which is there in US region. Will it work?

Highlighted
Cloudera Employee
Posts: 49
Registered: ‎10-14-2014

Re: Clusters in multiple regions managed single Manager/Director

The feature that John described above does not provide this functionality, and Director doesn't provide any way to make this work. It would be simple to create a new CM server (deployment) on the EU region and add the cluster to that, of course, but not to add that cluster to the US deployment.

It is technically *possible* to create a cluster this way, but this would need to be accomplished outside of Director. It would require some network configuration that may be inadvisable, though I'm not an expert here and it's not something we'd be able to support of help with.
Announcements