Created on
01-05-2020
11:17 PM
- last edited on
01-05-2020
11:56 PM
by
VidyaSargur
Hi - is there any documentation available for this version - most of the articles with nifi.properties for older versions are present, but the latest file does not contain the older properties.
Example - latest properties file does not contain
nifi.cluster.is.manager=true
etc and so on.
If someone could guide me on this setup steps required to have multiple nodes and a simple manager running - will be beneficial for me.
I am trying out these older properties too in the meantime.
Created 01-06-2020 05:53 AM
The existence of a dedicated manger instance of NiFi has not existed since the Apache NiFi 0.x versions.
As of Apache NiFi 1.x versions, NiFi now has HA at the controller level via the new zero master clustering capability. With zero master clustering there is no dedicated "manager" node. Instead NiFi clusters as of Apache NiFi 1.x require Zookeeper. Zookeeper receives connections from all nodes in a NiFi cluster and will elected one of those connecting nodes as the "cluster coordinator" (receives heartbeats from all other nodes and handle request replications and makes sure nodes stay in sync) and a nodes as the "primary node" (primary node will run processor components configured to run on primary node only).
This is why you will not find a "nifi.cluster.is.manager=true" property in the Apache NiFi 1.10 nifi.properties file. There are going to be number of new properties in Apache NiFi 1.x versions that did not exist in the older 0.x baselines.
You can find the latest admin guide with all the nifi.properties configuration properties defined here:
https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#system_properties
Hope this helps,
Matt
Created 01-06-2020 09:24 PM
Created 01-07-2020 08:40 AM
@Raghu_daredev
A good place to start is by reading this overview document:
https://nifi.apache.org/docs/nifi-docs/html/overview.html#nifi-architecture
Then you can get in to the details about NiFi clusters via the NiFi admin guide documentation:
https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#clustering
The above will walk you through the configuration properties needing to be set on all nodes in what will become your NiFi cluster.
Thank you,
Matt