CDF - configuring and managing isolated groups of nifi nodes

Question

Hello.

I have a HDF 3.2 cluster shared for different developing groups. It is running correctly but it's quickly growing bigger and bigger and we've decided to set up different isolated groups of NiFi nodes in order to prevent that a collapse on one project affects all the projects.

Our first idea was to install new HDF clusters but we want to manage all the resources with one unique Ambari console and also we want to share other resources (Kafka, NiFi Registry) between all the groups, but I've read that older versions of Ambari doesn't support managing multiple clusters (I don't know if this is still true).

What would be the recommended approach? It is possible to manage isolated groups in one unique cluster or multiple clusters managed by different ambari each is the only solution?

PD: If upgrading to CDF last version is necessary, that's something we're open to (we're already planning to do this in the near future).

Many thanks for your help

dyadav1 · Accepted Answer

In ambari you can create host configuration group and define the configs for those hosts instead of using default configuration by all the hosts. You can refer the below document for more details and steps:

https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/managing-and-monitoring-ambari/content/amb_managing_host_configuration_groups.html

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.