- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to pause after execution of 1000 flow files in NiFi
- Labels:
-
Apache NiFi
Created on 08-17-2023 02:11 AM - edited 08-17-2023 02:14 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have a template to do a post method using InvokeHTTP, there can be many number of post requests so, I want to pause the execution for 5 minutes after every 1000 flowfiles. Is it possible to get the count of flowfiles processed?
I tried creating a counter, but sadly I couldn't come up with a logic to increase the count.
I do not have any release signal identifier to use Wait processor.
please advise. Thanks in advance
Created 08-17-2023 05:37 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @scoutjohn ,
Have you looked into ControlRate processor?
In your case the processor configuration would be something like this:
If that helps please accept solution.
Thanks
Created 08-17-2023 05:37 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @scoutjohn ,
Have you looked into ControlRate processor?
In your case the processor configuration would be something like this:
If that helps please accept solution.
Thanks
Created 08-17-2023 06:29 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I think this is what I was trying to achieve, pause the execution for some time after processing 1000 flowfiles . Thank you
