Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

How to pause after execution of 1000 flow files in NiFi

avatar
Rising Star

I have a template to do a post method using InvokeHTTP, there can be many number of post requests so, I want to pause the execution for 5 minutes after every 1000 flowfiles. Is it possible to get the count of flowfiles processed?

scoutjohn_0-1692263107429.png

I tried creating a counter, but sadly I couldn't come up with a logic to increase the count. 
 I do not have any release signal identifier to use Wait processor. 

please advise. Thanks in advance

1 ACCEPTED SOLUTION

avatar
Super Guru

Hi @scoutjohn ,

 

Have you looked into ControlRate processor?

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.12.1/org.apach...

In your case the processor configuration would be something like this:

SAMSAL_0-1692275812944.png

 

If that helps please accept solution.

Thanks

 

View solution in original post

2 REPLIES 2

avatar
Super Guru

Hi @scoutjohn ,

 

Have you looked into ControlRate processor?

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.12.1/org.apach...

In your case the processor configuration would be something like this:

SAMSAL_0-1692275812944.png

 

If that helps please accept solution.

Thanks

 

avatar
Rising Star

I think this is what I was trying to achieve, pause the execution for some time after processing 1000 flowfiles . Thank you