Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Cloudera Director does not currently support creating multi-AZ instances.

Cloudera Director does not currently support creating multi-AZ instances.

Explorer

Cloudera Director does not currently support creating multi-AZ instances.

 

When this will be available ? is it possible to modify CF template to achieve this.

7 REPLIES 7

Re: Cloudera Director does not currently support creating multi-AZ instances.

Contributor

Hi,

 

This feature is on our roadmap, but we don't have a planned release date for it yet.

 

In the meanwhile, I confirmed with one of our engineers - it is possible to create a cluster that will have instance in multiple AZs today by using multiple instance templates (with different subnets) but Director will not take any action to configure rack information. 

 

Hope this helps,

Jayita

Re: Cloudera Director does not currently support creating multi-AZ instances.

Explorer

Thanks Jayita for great help so far.

 

what is rack information that director won't be able to configure.

 

Regards,

Kartik Bhatnagar

Re: Cloudera Director does not currently support creating multi-AZ instances.

Contributor

It is a Cloudera Manager configuration, that would need to be updated to handle multiple AZs.

 

Please note that this is not a supported or documented feature at this time. Once we release support for it, there will be additional details available. 

Re: Cloudera Director does not currently support creating multi-AZ instances.

Explorer

You have already answered before we can bring up cluster by changing subnets but some issue with rack information with cloudera manager. 

 

Can you please re-confirm issue related with rack/CM, if it is fixed or can we live with it by suppressing it, if no major impact.

If we setup multi-AZ based CDH by supplying two different subnets from different az each time.

Thanks !!
Regards,
Kartik

Re: Cloudera Director does not currently support creating multi-AZ instances.

Expert Contributor

Kartik,

 

Here's the Cloudera Manager documentation on racks.

http://www.cloudera.com/documentation/enterprise/latest/topics/cm_mc_specify_rack.html

 

The issue with running on multiple AZ is that increased network latency may affect data transfer or job performance. Rack awareness is used to mitigate this by running jobs closer to where the data lives.

 

You can assign racks to your hosts in CM after Director bootstraps or updates your cluster but there is no way to set racks through Director at this point.

 

If you have metrics for your desired performance level, then there's no replacement for measuring performance on an actual cluster as latency will be different depending on which AZ you choose.

 

David

Re: Cloudera Director does not currently support creating multi-AZ instances.

Explorer

Our major workload is mainly OLTP over Solr & Hbase. What would be your view on keeping Solr shards on two AZs or Hbase region server running over two AZs?

 

Thanks !!

Highlighted

Re: Cloudera Director does not currently support creating multi-AZ instances.

Expert Contributor

Kartik,

 

I don't have the expertise to answer that question. This may be better asked in the Cloudera Search forum

http://community.cloudera.com/t5/Cloudera-Search-Apache-SolrCloud/bd-p/Search

 

David