Reply
Explorer
Posts: 16
Registered: ‎01-21-2015

cdh installation on cloud - using automated scripts

Hi Team,

I am working on cloud environment setup( client have their on cloud environment other than AWS/.. ) where we have adhoc requirement for installing multiple Hadoop clusters . I am trying to build automated scripts for installing CDH5 and its components ( Cloudera Manager, NN, DN's , Edge Node , and related ecosystems such as hive, pig, spark .. ) .
What is the best way to automate this installation setup without much human interaction. Do we have any automated templates / ready scripts available which a user can customise based on their infra structure.


Thanks

Rath

Cloudera Employee
Posts: 576
Registered: ‎01-20-2014

Re: cdh installation on cloud - using automated scripts

You can set up Cloudera Director on a node within the VPC. Then create
various templates as per your cluster requirements and save them as conf
files on disk. When a new cluster is required, you can run a
"cloudera-director bootstrap-remote " and this will run an
automated cluster set up.

Does that make sense? The documentation is here:
http://cloudera.com/content/cloudera/en/documentation/cloudera-director/latest/PDF/cloudera-director...

Regards,
Gautam Gopalakrishnan
Cloudera Support
Cloudera Employee
Posts: 119
Registered: ‎10-13-2014

Re: cdh installation on cloud - using automated scripts

I think your best starting point is this set of example scripts that build on top of the Cloudera Manager API:

https://github.com/cloudera/cm_api/tree/master/python/examples/auto-deploy

 

Can you provide more details about their cloud environment? Is it based on one of the open source cloud platforms? 

Explorer
Posts: 16
Registered: ‎01-21-2015

Re: cdh installation on cloud - using automated scripts

Hi Gautham,

 

Thanks, I will have a look into Cloudera Director

 

Thanks,

Rath

Highlighted
New Contributor
Posts: 1
Registered: ‎06-05-2017

Re: cdh installation on cloud - using automated scripts

hi Rath

 

Did you get your automated cdh script worked on cloud? If so can you share details and documents on it.

 

Thanks

Announcements