question Re: How to pause after execution of 1000 flow files in NiFi in Support Questions

How to pause after execution of 1000 flow files in NiFi

scoutjohn — Thu, 17 Aug 2023 09:14:32 GMT

I have a template to do a post method using InvokeHTTP, there can be many number of post requests so, I want to pause the execution for 5 minutes after every 1000 flowfiles. Is it possible to get the count of flowfiles processed?

I tried creating a counter, but sadly I couldn't come up with a logic to increase the count.
I do not have any release signal identifier to use Wait processor.

please advise. Thanks in advance

Re: How to pause after execution of 1000 flow files in NiFi

SAMSAL — Thu, 17 Aug 2023 12:37:42 GMT

Hi @scoutjohn ,

Have you looked into ControlRate processor?

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.12.1/org.apache.nifi.processors.standard.ControlRate/

In your case the processor configuration would be something like this:

If that helps please accept solution.

Thanks

Re: How to pause after execution of 1000 flow files in NiFi

scoutjohn — Thu, 17 Aug 2023 13:29:02 GMT

I think this is what I was trying to achieve, pause the execution for some time after processing 1000 flowfiles . Thank you