Lets say I get flow files from a source every few minutes and need it delivered to Database A.
If Database A is offline then I'd like the flow files to temporarily go to Database B. When A comes back online then the data stored in B is first sent to A till B is "empty", then nifi continues and sends flowfiles to A. [B can be a database or flow files stored somewhere temporarily]
Is this possible or is there an alternative?
The scenario is that I get 10k flow files per 5 minutes. Queues set at 10000 backpressure will fill up pretty fast, blocking the whole dataflow. I need to be able to cater for a database going down.