Skip to main content
G-Tz
Silver ⭐️
December 6, 2020
Solved

NiFi - Fault tolerance

Greetings,

 

I work for a large organization that wants to purchase a NIFI system,
but before the purchase is made we need to know whether the system is Fault tolerant, in the sense that if a Node / Cluster crashes while consuming / processing / putting the data, it is possible to fully recover the data that was lost, automatically or manually.
If the answer is no, is it possible to set NIFI so it won't send Acks to the system from which it consumes the data from, until the moment the data completes the whole flow process and is uploaded to its destination, or at least until the data is uploaded properly to NIFI?

thank you!

Shelton
SheltonAnswer
Gold ⭐️⭐️⭐️
December 7, 2020

@G-Tz 
Yes NIfi is fault-tolerant is configured in a cluster min 3 nodes like the zookeeper that co-ordinates the cluster.

To get a better understanding please read through this Cloudera Nifi Clustering config

Happy hadooping

2 replies

Shelton
SheltonAnswer
Gold ⭐️⭐️⭐️
December 7, 2020

@G-Tz 
Yes NIfi is fault-tolerant is configured in a cluster min 3 nodes like the zookeeper that co-ordinates the cluster.

To get a better understanding please read through this Cloudera Nifi Clustering config

Happy hadooping

Translate
G-Tz
G-TzAuthor
Silver ⭐️
December 10, 2020

thank you very much Mr. Shelton

Translate