Support Questions
Find answers, ask questions, and share your expertise

cdh installation on cloud - using automated scripts

Explorer

Hi Team,

I am working on cloud environment setup( client have their on cloud environment other than AWS/.. ) where we have adhoc requirement for installing multiple Hadoop clusters . I am trying to build automated scripts for installing CDH5 and its components ( Cloudera Manager, NN, DN's , Edge Node , and related ecosystems such as hive, pig, spark .. ) .
What is the best way to automate this installation setup without much human interaction. Do we have any automated templates / ready scripts available which a user can customise based on their infra structure.


Thanks

Rath

5 REPLIES 5

You can set up Cloudera Director on a node within the VPC. Then create
various templates as per your cluster requirements and save them as conf
files on disk. When a new cluster is required, you can run a
"cloudera-director bootstrap-remote " and this will run an
automated cluster set up.

Does that make sense? The documentation is here:
http://cloudera.com/content/cloudera/en/documentation/cloudera-director/latest/PDF/cloudera-director...

Regards,
Gautam Gopalakrishnan

Explorer

Hi Gautham,

 

Thanks, I will have a look into Cloudera Director

 

Thanks,

Rath

New Contributor

hi Rath

 

Did you get your automated cdh script worked on cloud? If so can you share details and documents on it.

 

Thanks

New Contributor

Hi Gautham,

 

The Given Pre-Req link is not provising,shownig error 404.

Please update again.

 

 

 

thanks,

Usman Shariff.

Expert Contributor

I think your best starting point is this set of example scripts that build on top of the Cloudera Manager API:

https://github.com/cloudera/cm_api/tree/master/python/examples/auto-deploy

 

Can you provide more details about their cloud environment? Is it based on one of the open source cloud platforms?