Support Questions

Find answers, ask questions, and share your expertise

nifi process one flow file at the time

avatar
Expert Contributor

Hi

I have a listDataBaseTables which gives be 256 flowfiles. In my flow there is a lot of processing going on and i need to process one at the time.

Is it possible to trigger a processor only to continue when the flowfile before reach a certain processor, otherwise is it possible

to get a processor to continue each flowfile on a period of time so there is a timespand between each flowfile.

I have tried with a process eait using routeOnAttribute but it don't work as i want it to do.

Best regards Simon

1 ACCEPTED SOLUTION

avatar
Master Guru
@Simon Jespersen

If you know the time for 1 flowfile processing then

Try with Control Rate processor with below properties

Rate Control Criteria

flowfile count

Maximum Rate

1

Time Duration

1 min

Based on above property values Control Rate processor will release 1 flowfile per 1 minute.

Change the Time Duration value based on your one flowfile processing time.

Configs:-

47428-controlrate.png

(or)

You need to use Wait and Notify processors to release flowfiles if the flowfile reaches certain processor.

Refer the below link about how to use wait and notify processors

http://ijokarumawak.github.io/nifi/2017/02/02/nifi-notify-batch/

View solution in original post

2 REPLIES 2

avatar
Master Guru
@Simon Jespersen

If you know the time for 1 flowfile processing then

Try with Control Rate processor with below properties

Rate Control Criteria

flowfile count

Maximum Rate

1

Time Duration

1 min

Based on above property values Control Rate processor will release 1 flowfile per 1 minute.

Change the Time Duration value based on your one flowfile processing time.

Configs:-

47428-controlrate.png

(or)

You need to use Wait and Notify processors to release flowfiles if the flowfile reaches certain processor.

Refer the below link about how to use wait and notify processors

http://ijokarumawak.github.io/nifi/2017/02/02/nifi-notify-batch/

avatar
Expert Contributor

Thank you this worked for me