Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

nifi process one flow file at the time

avatar
Expert Contributor

Hi

I have a listDataBaseTables which gives be 256 flowfiles. In my flow there is a lot of processing going on and i need to process one at the time.

Is it possible to trigger a processor only to continue when the flowfile before reach a certain processor, otherwise is it possible

to get a processor to continue each flowfile on a period of time so there is a timespand between each flowfile.

I have tried with a process eait using routeOnAttribute but it don't work as i want it to do.

Best regards Simon

1 ACCEPTED SOLUTION

avatar
Master Guru
@Simon Jespersen

If you know the time for 1 flowfile processing then

Try with Control Rate processor with below properties

Rate Control Criteria

flowfile count

Maximum Rate

1

Time Duration

1 min

Based on above property values Control Rate processor will release 1 flowfile per 1 minute.

Change the Time Duration value based on your one flowfile processing time.

Configs:-

47428-controlrate.png

(or)

You need to use Wait and Notify processors to release flowfiles if the flowfile reaches certain processor.

Refer the below link about how to use wait and notify processors

http://ijokarumawak.github.io/nifi/2017/02/02/nifi-notify-batch/

View solution in original post

2 REPLIES 2

avatar
Master Guru
@Simon Jespersen

If you know the time for 1 flowfile processing then

Try with Control Rate processor with below properties

Rate Control Criteria

flowfile count

Maximum Rate

1

Time Duration

1 min

Based on above property values Control Rate processor will release 1 flowfile per 1 minute.

Change the Time Duration value based on your one flowfile processing time.

Configs:-

47428-controlrate.png

(or)

You need to use Wait and Notify processors to release flowfiles if the flowfile reaches certain processor.

Refer the below link about how to use wait and notify processors

http://ijokarumawak.github.io/nifi/2017/02/02/nifi-notify-batch/

avatar
Expert Contributor

Thank you this worked for me