Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

NiFi - Fault tolerance

avatar
Explorer

Greetings,

 

I work for a large organization that wants to purchase a NIFI system,
but before the purchase is made we need to know whether the system is Fault tolerant, in the sense that if a Node / Cluster crashes while consuming / processing / putting the data, it is possible to fully recover the data that was lost, automatically or manually.
If the answer is no, is it possible to set NIFI so it won't send Acks to the system from which it consumes the data from, until the moment the data completes the whole flow process and is uploaded to its destination, or at least until the data is uploaded properly to NIFI?

thank you!

1 ACCEPTED SOLUTION

avatar
Master Mentor

@G-Tz 
Yes NIfi is fault-tolerant is configured in a cluster min 3 nodes like the zookeeper that co-ordinates the cluster.

To get a better understanding please read through this Cloudera Nifi Clustering config

Happy hadooping

View solution in original post

2 REPLIES 2

avatar
Master Mentor

@G-Tz 
Yes NIfi is fault-tolerant is configured in a cluster min 3 nodes like the zookeeper that co-ordinates the cluster.

To get a better understanding please read through this Cloudera Nifi Clustering config

Happy hadooping

avatar
Explorer

thank you very much Mr. Shelton