Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Process a file first and then others (Wait and Notify)

Process a file first and then others (Wait and Notify)


Please help!

I'm reading three types of files thru ListFtp, for example:




I need to process the "TIT" file in first place. I need to read the data and insert the data to a table. After all the inserts finish I must process the "SEG" and "ASE" files.

I'm using wait and notify using fragment.count and fragment.identifier and it works, but I can´t connect Wait to ListFTP to get the files SEG and POS again, because ListFTP doesn't have entry point, it always runs in parallel.

I put a second wait to control the flow that process "SEG" and "ASE" files, the but it has no way of knowing fragment.count and fragment.identifier.

I am attaching an image that explains the problem.

Thanks in advance!


Wait configuration.


Notify configuration


Don't have an account?
Coming from Hortonworks? Activate your account here