Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Cluster manager setup in nifi.properties file for version 1.10

Cluster manager setup in nifi.properties file for version 1.10

New Contributor

Hi - is there any documentation available for this version - most of the articles with nifi.properties for older versions are present, but the latest file does not contain the older properties. 

 

Example - latest properties file does not contain

nifi.cluster.is.manager=true 

etc and so on. 

 

If someone could guide me on this setup steps required to have multiple nodes and a simple manager running - will be beneficial for me.

I am trying out these older properties too in the meantime. 

3 REPLIES 3

Re: Cluster manager setup in nifi.properties file for version 1.10

Master Guru

@Raghu_daredev 

 

The existence of a dedicated manger instance of NiFi has not existed since the Apache NiFi 0.x versions.

As of Apache NiFi 1.x versions, NiFi now has HA at the controller level via the new zero master clustering capability.  With zero master clustering there is no dedicated "manager" node.  Instead NiFi clusters as of Apache NiFi 1.x require Zookeeper.  Zookeeper receives connections from all nodes in a NiFi cluster and will elected one of those connecting nodes as the "cluster coordinator" (receives heartbeats from all other nodes and handle request replications and makes sure nodes stay in sync) and a nodes as the "primary node" (primary node will run processor components configured to run on primary node only).

This is why you will not find a "nifi.cluster.is.manager=true" property in the Apache NiFi 1.10 nifi.properties file.  There are going to be number of new properties in Apache NiFi 1.x versions that did not exist in the older 0.x baselines.

You can find the latest admin guide with all the nifi.properties configuration properties defined here:
https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#system_properties

Hope this helps,
Matt


Re: Cluster manager setup in nifi.properties file for version 1.10

New Contributor
Thank you, Matt.

Is there also an article which mentions how to configure this zero cluster
management stuff ?

Regards,
Raghu
Highlighted

Re: Cluster manager setup in nifi.properties file for version 1.10

Master Guru

@Raghu_daredev 

A good place to start is by reading this overview document:
https://nifi.apache.org/docs/nifi-docs/html/overview.html#nifi-architecture

Then you can get in to the details about NiFi clusters via the NiFi admin guide documentation:
https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#clustering

 

The above will walk you through the configuration properties needing to be set on all nodes in what will become your NiFi cluster.

Thank you,

Matt

Don't have an account?
Coming from Hortonworks? Activate your account here