Support Questions

Find answers, ask questions, and share your expertise

How to pause after execution of 1000 flow files in NiFi

avatar
Rising Star

I have a template to do a post method using InvokeHTTP, there can be many number of post requests so, I want to pause the execution for 5 minutes after every 1000 flowfiles. Is it possible to get the count of flowfiles processed?

scoutjohn_0-1692263107429.png

I tried creating a counter, but sadly I couldn't come up with a logic to increase the count. 
 I do not have any release signal identifier to use Wait processor. 

please advise. Thanks in advance

1 ACCEPTED SOLUTION

avatar
Super Guru

Hi @scoutjohn ,

 

Have you looked into ControlRate processor?

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.12.1/org.apach...

In your case the processor configuration would be something like this:

SAMSAL_0-1692275812944.png

 

If that helps please accept solution.

Thanks

 

View solution in original post

2 REPLIES 2

avatar
Super Guru

Hi @scoutjohn ,

 

Have you looked into ControlRate processor?

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.12.1/org.apach...

In your case the processor configuration would be something like this:

SAMSAL_0-1692275812944.png

 

If that helps please accept solution.

Thanks

 

avatar
Rising Star

I think this is what I was trying to achieve, pause the execution for some time after processing 1000 flowfiles . Thank you