Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

cdh installation on cloud - using automated scripts

cdh installation on cloud - using automated scripts

Explorer

Hi Team,

I am working on cloud environment setup( client have their on cloud environment other than AWS/.. ) where we have adhoc requirement for installing multiple Hadoop clusters . I am trying to build automated scripts for installing CDH5 and its components ( Cloudera Manager, NN, DN's , Edge Node , and related ecosystems such as hive, pig, spark .. ) .
What is the best way to automate this installation setup without much human interaction. Do we have any automated templates / ready scripts available which a user can customise based on their infra structure.


Thanks

Rath

5 REPLIES 5

Re: cdh installation on cloud - using automated scripts

You can set up Cloudera Director on a node within the VPC. Then create
various templates as per your cluster requirements and save them as conf
files on disk. When a new cluster is required, you can run a
"cloudera-director bootstrap-remote " and this will run an
automated cluster set up.

Does that make sense? The documentation is here:
http://cloudera.com/content/cloudera/en/documentation/cloudera-director/latest/PDF/cloudera-director...

Regards,
Gautam Gopalakrishnan

Re: cdh installation on cloud - using automated scripts

Explorer

Hi Gautham,

 

Thanks, I will have a look into Cloudera Director

 

Thanks,

Rath

Re: cdh installation on cloud - using automated scripts

New Contributor

hi Rath

 

Did you get your automated cdh script worked on cloud? If so can you share details and documents on it.

 

Thanks

Re: cdh installation on cloud - using automated scripts

New Contributor

Hi Gautham,

 

The Given Pre-Req link is not provising,shownig error 404.

Please update again.

 

 

 

thanks,

Usman Shariff.

Re: cdh installation on cloud - using automated scripts

Expert Contributor

I think your best starting point is this set of example scripts that build on top of the Cloudera Manager API:

https://github.com/cloudera/cm_api/tree/master/python/examples/auto-deploy

 

Can you provide more details about their cloud environment? Is it based on one of the open source cloud platforms?