question Re: How to install CM over an existing CDH Cluster in Support Questions

How to install CM over an existing CDH Cluster

storysj — Fri, 16 Sep 2022 09:07:26 GMT

Hello,

I'm hoping someone can inform me as to whether its possible for Cloudera Manager to "discover" and then continue to monitor pre-installed, configured, and running CDH components? I use SaltStack to programmatically install and configure my cluster to run hbase, hive, impala, oozie, and hue, along with just the core-hadoop processes. The clusters work great. But I'd like to be able to add ClouderManager to the mix, to be able to monitor my cluster after-the-fact. Is that possible at all? My understanding is that both the API and the CM UI force you to re-specify your configuration, and then restart your services, which I would like to avoid.

Can you advise?

Re: Programmatically install and configure CM on cluster with pre-existing CDH components

Clint — Fri, 19 Sep 2014 20:44:00 GMT

It is true that a restart would be required at some point along the way if you tried to overlay Cloudera Manager on top of an existing CDH cluster. You would also need to take very careful steps to assure that all your configs were ported into CM during the install process, it's not really a documented process because it can cause data loss if you don't know what you're doing. see this thread

Cloudera Manager is not just a monitoring tool, it is an entire management suite and wants to install, configure, monitor, and report on your cluster. Just keep in mind that CM will move your configs around and wants to manage all those settings and keep it's own log directories, etc. It will not drop in seemlessly into an existing suite of tools that are managing the cluster and only do the monitoring piece for you.

HTH

Re: Programmatically install and configure CM on cluster with pre-existing CDH components

storysj — Mon, 22 Sep 2014 14:57:12 GMT

Not exactly the answer I was hoping to hear, but thank you. Definitely answered my question.

Re: Programmatically install and configure CM on cluster with pre-existing CDH components

vkii — Fri, 07 Nov 2014 03:22:22 GMT

I have the same issue as well, and find out it's hard to get there.

Re: Programmatically install and configure CM on cluster with pre-existing CDH components

Zhuo.Chen — Tue, 06 Jan 2015 08:13:12 GMT

Great issue. I still hope Cloudera Manager can take over a cluster that managed by other Cloudera Manager.

That is different Problem but same Request.

Re: How to install CM over an existing CDH Cluster

jiajiacloudera — Thu, 05 Feb 2015 08:09:59 GMT

I wanted to do this some days ago .And one senior told me that I'd better reinstall the cluster through CM. So the answer should be: " can't".

Re: How to install CM over an existing CDH Cluster

UlkaAsati — Tue, 31 Mar 2015 10:44:24 GMT

I am too facing similar problem. does anyone know how can cloud manager on different host manage CDH ? Does this option available for enterprise free trial version and not for cloud express?

Re: How to install CM over an existing CDH Cluster

Grizzly — Sat, 04 Apr 2015 20:55:35 GMT

Are you trying to move cloudera manager to another host/database type? Or just re-locate the cloudera manager server?

Re: How to install CM over an existing CDH Cluster

UlkaAsati — Tue, 07 Apr 2015 08:15:23 GMT

Hi,

Its a fresh install. (manual, Installation path B). Only the thing I have not installed cloudera manager on same host where CDH is installed.

Cloudera manager is installed on diifferent host. CDH is installed on different host. Cloudera manager agent is installed on VM where CDH is installed.

Using external postgresql databse

Re: How to install CM over an existing CDH Cluster

Grizzly — Thu, 07 May 2015 05:25:35 GMT

Ok so flat out, if the CDH cluster is new along with the CM install... the whole point of CM is to deploy and manage CDH, so installing CDH by itself basically lays down configuration that can not be ingested automatically into CM. For a one node cluster, it should be possible to add a node via CM (add host) and then deploy CDH over that. Any significant configuration changes you made directly in CDH as far as non default settings, can be configured within CM.

If there is significant data in the CDH one node cluster you have, distcp can be used to copy data from CDH cluster to CM manage clusters CDH.

Re: How to install CM over an existing CDH Cluster

Grizzly — Tue, 26 May 2015 00:15:10 GMT

One other point, to build and manage clusters programatically, take a look at the Python Client API

For background and general information and general concepts and API documentation.

http://cloudera.github.io/cm_api/

For functional client setup for using examples:

https://github.com/cloudera/cm_api

And the "auto deploy" example within it (you must set up the client, above before you can use the example.

https://github.com/cloudera/cm_api/tree/master/python/examples/auto-deploy