Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

cdh installation on cloud - using automated scripts

cdh installation on cloud - using automated scripts

Explorer

Hi Team,

I am working on cloud environment setup( client have their on cloud environment other than AWS/.. ) where we have adhoc requirement for installing multiple Hadoop clusters . I am trying to build automated scripts for installing CDH5 and its components ( Cloudera Manager, NN, DN's , Edge Node , and related ecosystems such as hive, pig, spark .. ) .
What is the best way to automate this installation setup without much human interaction. Do we have any automated templates / ready scripts available which a user can customise based on their infra structure.


Thanks

Rath

5 REPLIES 5

Re: cdh installation on cloud - using automated scripts

You can set up Cloudera Director on a node within the VPC. Then create
various templates as per your cluster requirements and save them as conf
files on disk. When a new cluster is required, you can run a
"cloudera-director bootstrap-remote " and this will run an
automated cluster set up.

Does that make sense? The documentation is here:
http://cloudera.com/content/cloudera/en/documentation/cloudera-director/latest/PDF/cloudera-director...

Regards,
Gautam Gopalakrishnan

Re: cdh installation on cloud - using automated scripts

Explorer

Hi Gautham,

 

Thanks, I will have a look into Cloudera Director

 

Thanks,

Rath

Re: cdh installation on cloud - using automated scripts

New Contributor

hi Rath

 

Did you get your automated cdh script worked on cloud? If so can you share details and documents on it.

 

Thanks

Highlighted

Re: cdh installation on cloud - using automated scripts

New Contributor

Hi Gautham,

 

The Given Pre-Req link is not provising,shownig error 404.

Please update again.

 

 

 

thanks,

Usman Shariff.

Re: cdh installation on cloud - using automated scripts

Expert Contributor

I think your best starting point is this set of example scripts that build on top of the Cloudera Manager API:

https://github.com/cloudera/cm_api/tree/master/python/examples/auto-deploy

 

Can you provide more details about their cloud environment? Is it based on one of the open source cloud platforms? 

Don't have an account?
Coming from Hortonworks? Activate your account here