Support Questions

Find answers, ask questions, and share your expertise

How to use control rate processor based on flow file processing status?

avatar
Contributor

Hi,

 

I have a nifi flow which has 1000's of flow files. Each of the flow file has an impala/hive statement and each of them have different execution times. How do i use control rate processor to trigger next flow file only if the previous flow file has been processed (success/failure of the flow file doesn't matter)?

2 REPLIES 2

avatar
Super Guru

Hi @brajeshreddy ,

I dont think you can achieve this using the ControlRate processor. Instead I recommend the solution mentioned here: https://stackoverflow.com/questions/69893107/nifi-activate-a-flow-file-after-a-previous-flow-file-go...

 

If you have a cluster then make sure that the top processor is executing on the Primary node.

 

hope that helps.

Thanks

 

avatar
Contributor

@SAMSAL This looks like a plausible solution. Let me try it out.