Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to configure cloudera manager managed cluster via input file?

Solved Go to solution
Highlighted

How to configure cloudera manager managed cluster via input file?

New Contributor

I have a cloudera cluster installed with the cloudera manager, server and agent RPMs, server and agents are all started up.

 

  Normally I'll use firefox/Chrome to connect to port 7180 of the cloudera server host, and then follow the configuration templates

to select cluster node, services, roles assignment, and finish configuration job.


But the question is: Is there a way for me to specify all the parameters in an input file, and then configure the cluster with command line tools, with the input file(s) as input?

 

Basically I'd like to configure a cluster automatically instead of interaction with Web UI. Any one can shed a light on this? Thanks.


Thanks a lot.

3 ACCEPTED SOLUTIONS

Accepted Solutions

Re: How to configure cloudera manager managed cluster via input file?

Explorer

Have you consider using the Cloudera Manager API tools?

 

http://cloudera.github.io/cm_api/docs/quick-start/

 

http://cloudera.github.io/cm_api/apidocs/v10/index.html

 

We are using Chef to update CM so that our configuratons stay in sync.  We can spin up a cluster and change settings but can still us CM to make other changes later on.

Re: How to configure cloudera manager managed cluster via input file?

New Contributor

Thanks. That's pretty helpful.

 

I am a newbie to cloudera manager, normally I setup cluster(s) with Web UI step by step. With a new business requirement to create clusters on the fly with REST API, I get completely lost here.

 

 What's the Steps -- and APIs to call -- for creation of a cluster, with services, and roles, tunning some settings, and then finally bring services up?

 

  1, create cluster

  2, create HDFS, and YARN services

  3, assign hosts -- and their roles -- to  services

  4, tunning a few services parameters

  5, bring up services initially

  6, check cluster, services, and hosts' health status

 

Do anyone has a working steps, API calling sequences for creating HDFS and YARN services on the fly? Thanks.

 

 

  

Re: How to configure cloudera manager managed cluster via input file?

If you're running on EC2, Cloudera Director makes all this very easy for you.

The CM API client bindings has some examples here:
https://github.com/cloudera/cm_api/tree/master/python/examples
3 REPLIES 3

Re: How to configure cloudera manager managed cluster via input file?

Explorer

Have you consider using the Cloudera Manager API tools?

 

http://cloudera.github.io/cm_api/docs/quick-start/

 

http://cloudera.github.io/cm_api/apidocs/v10/index.html

 

We are using Chef to update CM so that our configuratons stay in sync.  We can spin up a cluster and change settings but can still us CM to make other changes later on.

Re: How to configure cloudera manager managed cluster via input file?

New Contributor

Thanks. That's pretty helpful.

 

I am a newbie to cloudera manager, normally I setup cluster(s) with Web UI step by step. With a new business requirement to create clusters on the fly with REST API, I get completely lost here.

 

 What's the Steps -- and APIs to call -- for creation of a cluster, with services, and roles, tunning some settings, and then finally bring services up?

 

  1, create cluster

  2, create HDFS, and YARN services

  3, assign hosts -- and their roles -- to  services

  4, tunning a few services parameters

  5, bring up services initially

  6, check cluster, services, and hosts' health status

 

Do anyone has a working steps, API calling sequences for creating HDFS and YARN services on the fly? Thanks.

 

 

  

Re: How to configure cloudera manager managed cluster via input file?

If you're running on EC2, Cloudera Director makes all this very easy for you.

The CM API client bindings has some examples here:
https://github.com/cloudera/cm_api/tree/master/python/examples