Support Questions
Find answers, ask questions, and share your expertise

nifi clusters

Solved Go to solution
Highlighted

nifi clusters

Expert Contributor

Hi,

I read that nifi provides centralized management of the data flow, does it mean that if we set up a nifi cluster of multiple instances/nodes, they would use the same NiFi repository (flow file, content, prov). In that case how does it use a shared file system.

Thanks,

Avijeet

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: nifi clusters

Master Guru

@Avijeet Dash

Every Node in a NiFi cluster run with their own repositories, flow.xml.gz, and work with their own set of data. Nodes in a cluster are unaware of what data other nodes in the cluster are working on. Once a cluster coordinator is elected all nodes send heartbeats to that node. Nodes cannot share repositories.

When you access the UI via any Node in the cluster, the UI will show the cumulative stats of the entire cluster to the user. The centralized management aspect comes in to play here. Any changes you make within NiFi (no matter which node UI you are logged into) will be replicated to all nodes in the cluster.

Thanks,

Matt

View solution in original post

2 REPLIES 2

Re: nifi clusters

Avijeet, take a look at NiFi deeper architectural documents, I recommend https://nifi.apache.org/docs/nifi-docs/html/nifi-in-depth.html

Highlighted

Re: nifi clusters

Master Guru

@Avijeet Dash

Every Node in a NiFi cluster run with their own repositories, flow.xml.gz, and work with their own set of data. Nodes in a cluster are unaware of what data other nodes in the cluster are working on. Once a cluster coordinator is elected all nodes send heartbeats to that node. Nodes cannot share repositories.

When you access the UI via any Node in the cluster, the UI will show the cumulative stats of the entire cluster to the user. The centralized management aspect comes in to play here. Any changes you make within NiFi (no matter which node UI you are logged into) will be replicated to all nodes in the cluster.

Thanks,

Matt

View solution in original post