Support Questions
Find answers, ask questions, and share your expertise

Nifi: handling offline databases and redirecting flow files

Highlighted

Nifi: handling offline databases and redirecting flow files

Explorer

Lets say I get flow files from a source every few minutes and need it delivered to Database A.

 

If Database A is offline then I'd like the flow files to temporarily go to Database B. When A comes back online then the data stored in B is first sent to A till B is "empty", then nifi continues and sends flowfiles to A. [B can be a database or flow files stored somewhere temporarily]

 

Is this possible or is there an alternative?

 

The scenario is that I get 10k flow files per 5 minutes. Queues set at 10000 backpressure will fill up pretty fast, blocking the whole dataflow. I need to be able to cater for a database going down.

 

Thanks.

Don't have an account?