Support Questions

Find answers, ask questions, and share your expertise

Rate limit in a clusterized NiFi installation

avatar
Explorer

Dear community,

 

We have a NiFi cluster installation of 3 nodes, and we need to call on an API that demands to be called, at most, once every 5 seconds. We found the ControlRate processor which seems exactly what we need, but at our 3 nodes installation ends up doing 3 calls every 5 seconds. Is ControlRate only meant to be used on a single node installation, or on flows that start from a processor set to Primary Only? Is there any way to use ControlRate in a multi node installation, or any combination of processors that would allow us to get that result? We are running NiFi 1.7.1 but if there is any solution in a newer NiFi we may be able to backport it. Thanks a lot for any advice on this.

 

Best Regards!!

  JP

0 REPLIES 0