question Re: NiFi Registry cluster mode in Support Questions

NiFi Registry cluster mode

sparepally — Fri, 20 Apr 2018 05:59:44 GMT

Hi,

We are trying out NiFi Registry v 0.1.0.3.1.1.0-35 and is working fine with Single Node setup. But we would like to set it up in cluster mode.

Is cluster mode supported for NiFi registry?

Currently, Nifi registry is storing data in local database, is it a recommended approach to share this db directory over NFS mount and start nifi registry in HA mode?

Re: NiFi Registry cluster mode

alim — Fri, 20 Apr 2018 06:59:22 GMT

Hi @Saikiran Parepally

Cluster mode is currently not supported for NiFi Registry. But some thought has been given to HA:

https://issues.apache.org/jira/browse/NIFIREG-150

Re: NiFi Registry cluster mode

sparepally — Fri, 20 Apr 2018 07:02:49 GMT

Thanks, @Andrew Lim for the update.

Is it a recommended approach to keep db location on a shared mount and start service on multiple servers? I see a risk of data corruption, if multiple services try to write to same file at the same time.

Re: NiFi Registry cluster mode

kevdoran — Fri, 20 Apr 2018 07:13:00 GMT

@Saikiran Parepally It is not recommended to start multiple servers. Some data is cached in memory, so in addition to the data corruption potential you noted, multiple instances pointed to the shared storage location would become out of sync over time.

A better approach for now might be to focus on backing up the data to another location for recovery or for spinning up a cold-spare if your NiFi Registry goes offline. This is not yet a feature of NiFi Registry, so you would have to design and build such a mechanism yourself on top of NiFi Registry. The JIRA @Andrew Lim linked to, NIFIREG-150, is a good collection of ideas for possibilities.

If you need backup or HA features, I would recommend commenting on existing JIRAs or open new feature requests. This service is still new so we are looking for feedback from users to prioritize next steps.

Re: NiFi Registry cluster mode

sparepally — Fri, 20 Apr 2018 07:15:03 GMT

Thanks, @kdoran for the response. Will create JIRA's for new feature requests.

Re: NiFi Registry cluster mode

elbert — Mon, 23 Nov 2020 15:18:06 GMT

@alim Do you have any update on this? Is there a preferred way to handle HA?

Thanks,

Alex