NiFi Registry cluster mode

[#1]

Hi,

We are trying out NiFi Registry v 0.1.0.3.1.1.0-35 and is working fine with Single Node setup. But we would like to set it up in cluster mode.

Is cluster mode supported for NiFi registry?

Currently, Nifi registry is storing data in local database, is it a recommended approach to share this db directory over NFS mount and start nifi registry in HA mode?

[#2 · Accepted solution]

Hi @Saikiran Parepally

Cluster mode is currently not supported for NiFi Registry. But some thought has been given to HA:

https://issues.apache.org/jira/browse/NIFIREG-150

[#3]

@alim Do you have any update on this? Is there a preferred way to handle HA?

Thanks,

Alex

[#4]

Thanks, @Andrew Lim for the update.

Is it a recommended approach to keep db location on a shared mount and start service on multiple servers? I see a risk of data corruption, if multiple services try to write to same file at the same time.

[#5]

@Saikiran Parepally It is not recommended to start multiple servers. Some data is cached in memory, so in addition to the data corruption potential you noted, multiple instances pointed to the shared storage location would become out of sync over time.

A better approach for now might be to focus on backing up the data to another location for recovery or for spinning up a cold-spare if your NiFi Registry goes offline. This is not yet a feature of NiFi Registry, so you would have to design and build such a mechanism yourself on top of NiFi Registry. The JIRA @Andrew Lim linked to, NIFIREG-150, is a good collection of ideas for possibilities.

If you need backup or HA features, I would recommend commenting on existing JIRAs or open new feature requests. This service is still new so we are looking for feedback from users to prioritize next steps.

[#6]

Thanks, @kdoran for the response. Will create JIRA's for new feature requests.