question Re: NiFi - Fault tolerance in Support Questions

NiFi - Fault tolerance

G-Tz — Sun, 06 Dec 2020 14:49:35 GMT

Greetings,

I work for a large organization that wants to purchase a NIFI system,
but before the purchase is made we need to know whether the system is Fault tolerant, in the sense that if a Node / Cluster crashes while consuming / processing / putting the data, it is possible to fully recover the data that was lost, automatically or manually.
If the answer is no, is it possible to set NIFI so it won't send Acks to the system from which it consumes the data from, until the moment the data completes the whole flow process and is uploaded to its destination, or at least until the data is uploaded properly to NIFI?

thank you!

Re: NiFi - Fault tolerance

Shelton — Mon, 07 Dec 2020 21:54:28 GMT

@G-Tz
Yes NIfi is fault-tolerant is configured in a cluster min 3 nodes like the zookeeper that co-ordinates the cluster.

To get a better understanding please read through this Cloudera Nifi Clustering config

Happy hadooping

Re: NiFi - Fault tolerance

G-Tz — Thu, 10 Dec 2020 11:07:35 GMT

thank you very much Mr. Shelton