Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

How to use control rate processor based on flow file processing status?

avatar
Contributor

Hi,

 

I have a nifi flow which has 1000's of flow files. Each of the flow file has an impala/hive statement and each of them have different execution times. How do i use control rate processor to trigger next flow file only if the previous flow file has been processed (success/failure of the flow file doesn't matter)?

2 REPLIES 2

avatar

Hi @brajeshreddy ,

I dont think you can achieve this using the ControlRate processor. Instead I recommend the solution mentioned here: https://stackoverflow.com/questions/69893107/nifi-activate-a-flow-file-after-a-previous-flow-file-go...

 

If you have a cluster then make sure that the top processor is executing on the Primary node.

 

hope that helps.

Thanks

 

avatar
Contributor

@SAMSAL This looks like a plausible solution. Let me try it out.