Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Nifi sftp - Wait for Control file before processing a file

Highlighted

Nifi sftp - Wait for Control file before processing a file

Hi,

 

We are pulling files from sftp server, and we get two types of files.

1. data file

2. control file

 

We need to wait for the control file before processing the data file.

 

Is there a recommended pattern to implement this behavior in nifi?

 

Thank you

1 REPLY 1

Re: Nifi sftp - Wait for Control file before processing a file

Expert Contributor

First of all, the recommended pattern is to avoid this. The most common problems. people are trying to solve are waiting for a file to be copied, or depending on multiple files. In both cases you should be able fine by just listening to the directory.

 

If you actually have a more complicated situation, the first thing that comes to mind is a design with wait notify. Here is an article that explains this: http://ijokarumawak.github.io/nifi/2017/02/02/nifi-notify-batch/

 

To help future readers please consider marking this as 'solved' and or valuable ('kudos') 


- Dennis Jaheruddin

If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'. Also check out my techincal portfolio at https://portfolio.jaheruddin.nl
Don't have an account?
Coming from Hortonworks? Activate your account here