Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Process a file first and then others (Wait and Notify)

Highlighted

Process a file first and then others (Wait and Notify)

New Contributor

Please help!

I'm reading three types of files thru ListFtp, for example:

TRB_TIT_D190125.txt

TRB_SEG_D190125.txt

TRB_ASE_D190125.txt

I need to process the "TIT" file in first place. I need to read the data and insert the data to a table. After all the inserts finish I must process the "SEG" and "ASE" files.

I'm using wait and notify using fragment.count and fragment.identifier and it works, but I can´t connect Wait to ListFTP to get the files SEG and POS again, because ListFTP doesn't have entry point, it always runs in parallel.

I put a second wait to control the flow that process "SEG" and "ASE" files, the but it has no way of knowing fragment.count and fragment.identifier.

I am attaching an image that explains the problem.

Thanks in advance!


107991-nifi-flow.jpg

Wait configuration.

108001-wait-configuration.jpg


Notify configuration

108011-notify-configuration.jpg

Don't have an account?
Coming from Hortonworks? Activate your account here