Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi: Wait all fragments then release once last fragment arrives in Notify

Highlighted

NiFi: Wait all fragments then release once last fragment arrives in Notify

Contributor

I am prototyping a flow where a JSON will be split to fragments then after some intermediate processing, will be routed to Wait and Notify processors (basically they diverge after some time after some number of processes). On the side of Wait, I want all fragments to be released almost simultaneously once Notify that the last fragment ( max(fragment.index) = fragment.count - 1 ) have arrived.

43508-split-wait-notify.png

My assumption is that fragment.index follows the processing sequence right after the SplitJSON (is this correct?). If the previous assumption is correct, let us assume that the intermediate processes after SplitJSON up to Notify preserves such ordering.

How do I configure Wait and Notify for it to work this way? Is there a better solution than what I am thinking?

1 REPLY 1

Re: NiFi: Wait all fragments then release once last fragment arrives in Notify

New Contributor

did you get it to work?

newer NiFi-Versions (i'm on 1.7) seem to must have a distributed cache service as well for the wait / notify pattern

Don't have an account?
Coming from Hortonworks? Activate your account here