Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Cluster manager setup in nifi.properties file for version 1.10

Hi - is there any documentation available for this version - most of the articles with nifi.properties for older versions are present, but the latest file does not contain the older properties. 

 

Example - latest properties file does not contain

nifi.cluster.is.manager=true 

etc and so on. 

 

If someone could guide me on this setup steps required to have multiple nodes and a simple manager running - will be beneficial for me.

I am trying out these older properties too in the meantime. 

3 REPLIES 3

Mentor

@Raghu_daredev 

 

The existence of a dedicated manger instance of NiFi has not existed since the Apache NiFi 0.x versions.

As of Apache NiFi 1.x versions, NiFi now has HA at the controller level via the new zero master clustering capability.  With zero master clustering there is no dedicated "manager" node.  Instead NiFi clusters as of Apache NiFi 1.x require Zookeeper.  Zookeeper receives connections from all nodes in a NiFi cluster and will elected one of those connecting nodes as the "cluster coordinator" (receives heartbeats from all other nodes and handle request replications and makes sure nodes stay in sync) and a nodes as the "primary node" (primary node will run processor components configured to run on primary node only).

This is why you will not find a "nifi.cluster.is.manager=true" property in the Apache NiFi 1.10 nifi.properties file.  There are going to be number of new properties in Apache NiFi 1.x versions that did not exist in the older 0.x baselines.

You can find the latest admin guide with all the nifi.properties configuration properties defined here:
https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#system_properties

Hope this helps,
Matt


Thank you, Matt.

Is there also an article which mentions how to configure this zero cluster
management stuff ?

Regards,
Raghu

Mentor

@Raghu_daredev 

A good place to start is by reading this overview document:
https://nifi.apache.org/docs/nifi-docs/html/overview.html#nifi-architecture

Then you can get in to the details about NiFi clusters via the NiFi admin guide documentation:
https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#clustering

 

The above will walk you through the configuration properties needing to be set on all nodes in what will become your NiFi cluster.

Thank you,

Matt

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.