Created on 09-11-2014 03:01 PM - edited 09-16-2022 02:07 AM
Hello,
I'm hoping someone can inform me as to whether its possible for Cloudera Manager to "discover" and then continue to monitor pre-installed, configured, and running CDH components? I use SaltStack to programmatically install and configure my cluster to run hbase, hive, impala, oozie, and hue, along with just the core-hadoop processes. The clusters work great. But I'd like to be able to add ClouderManager to the mix, to be able to monitor my cluster after-the-fact. Is that possible at all? My understanding is that both the API and the CM UI force you to re-specify your configuration, and then restart your services, which I would like to avoid.
Can you advise?
Created 09-19-2014 01:44 PM
It is true that a restart would be required at some point along the way if you tried to overlay Cloudera Manager on top of an existing CDH cluster. You would also need to take very careful steps to assure that all your configs were ported into CM during the install process, it's not really a documented process because it can cause data loss if you don't know what you're doing. see this thread
Cloudera Manager is not just a monitoring tool, it is an entire management suite and wants to install, configure, monitor, and report on your cluster. Just keep in mind that CM will move your configs around and wants to manage all those settings and keep it's own log directories, etc. It will not drop in seemlessly into an existing suite of tools that are managing the cluster and only do the monitoring piece for you.
HTH
Created 05-25-2015 05:15 PM
One other point, to build and manage clusters programatically, take a look at the Python Client API
For background and general information and general concepts and API documentation.
http://cloudera.github.io/cm_api/
For functional client setup for using examples:
https://github.com/cloudera/cm_api
And the "auto deploy" example within it (you must set up the client, above before you can use the example.
https://github.com/cloudera/cm_api/tree/master/python/examples/auto-deploy