Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi Registry cluster mode

Solved Go to solution
Highlighted

NiFi Registry cluster mode

Contributor

Hi,

We are trying out NiFi Registry v 0.1.0.3.1.1.0-35 and is working fine with Single Node setup. But we would like to set it up in cluster mode.

Is cluster mode supported for NiFi registry?

Currently, Nifi registry is storing data in local database, is it a recommended approach to share this db directory over NFS mount and start nifi registry in HA mode?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: NiFi Registry cluster mode

Guru

Hi @Saikiran Parepally

Cluster mode is currently not supported for NiFi Registry. But some thought has been given to HA:

https://issues.apache.org/jira/browse/NIFIREG-150

4 REPLIES 4

Re: NiFi Registry cluster mode

Guru

Hi @Saikiran Parepally

Cluster mode is currently not supported for NiFi Registry. But some thought has been given to HA:

https://issues.apache.org/jira/browse/NIFIREG-150

Re: NiFi Registry cluster mode

Contributor

Thanks, @Andrew Lim for the update.

Is it a recommended approach to keep db location on a shared mount and start service on multiple servers? I see a risk of data corruption, if multiple services try to write to same file at the same time.

Re: NiFi Registry cluster mode

New Contributor

@Saikiran Parepally It is not recommended to start multiple servers. Some data is cached in memory, so in addition to the data corruption potential you noted, multiple instances pointed to the shared storage location would become out of sync over time.

A better approach for now might be to focus on backing up the data to another location for recovery or for spinning up a cold-spare if your NiFi Registry goes offline. This is not yet a feature of NiFi Registry, so you would have to design and build such a mechanism yourself on top of NiFi Registry. The JIRA @Andrew Lim linked to, NIFIREG-150, is a good collection of ideas for possibilities.

If you need backup or HA features, I would recommend commenting on existing JIRAs or open new feature requests. This service is still new so we are looking for feedback from users to prioritize next steps.

Re: NiFi Registry cluster mode

Contributor

Thanks, @kdoran for the response. Will create JIRA's for new feature requests.

Don't have an account?
Coming from Hortonworks? Activate your account here