- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to use control rate processor based on flow file processing status?
Created ‎07-25-2023 07:20 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
I have a nifi flow which has 1000's of flow files. Each of the flow file has an impala/hive statement and each of them have different execution times. How do i use control rate processor to trigger next flow file only if the previous flow file has been processed (success/failure of the flow file doesn't matter)?
Created ‎07-25-2023 11:14 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @brajeshreddy ,
I dont think you can achieve this using the ControlRate processor. Instead I recommend the solution mentioned here: https://stackoverflow.com/questions/69893107/nifi-activate-a-flow-file-after-a-previous-flow-file-go...
If you have a cluster then make sure that the top processor is executing on the Primary node.
hope that helps.
Thanks
Created ‎07-26-2023 06:51 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@SAMSAL This looks like a plausible solution. Let me try it out.
