Created 10-15-2015 01:56 AM
Is there a way I can configure nifi, not to pull same files over? It appears to pull the same files more than once if some files in the directory were modified.
I.e. could you explain the full algorithm behavior on how GetSFTP tracks which files it has downloaded?
And how does this behave in case NiFi process or the server restarts?
Created 10-15-2015 02:17 PM
Wes,
The next version of NiFi will have new components like FetchSFTP and ListSFTP [1]:
I have already used the FetchSFTP to tell it which files to get, triggered by an external notification.
Created 10-15-2015 02:01 AM
There is the "Delete Original" property which is set to 'true' by default. Is that what you are looking for? With that in mind I can't understand what do you mean about files been modified as one would expect them to be gone, can you clarify?
Created 10-15-2015 02:17 PM
Wes,
The next version of NiFi will have new components like FetchSFTP and ListSFTP [1]:
I have already used the FetchSFTP to tell it which files to get, triggered by an external notification.
Created 12-18-2015 08:47 PM
Hi Andrew, Can you please share the template with us? Not sure how to configure FetchSFTP to read output from ListSFTP. It keeps asking for the remote file location Thank you !
Created 12-18-2015 10:32 PM
list-and-fetch-sftp-templatexml.zipTry the attached template. Also check out the repo our team is populating here: https://community.hortonworks.com/repos/6119/apache-nifi-template-rpo.html
Created 09-21-2016 06:27 AM
Hi,
Is there any way where we can trigger ListSFTP based on some status condition. Say ListSFTP should pick or transfer files based on some status. for example if status is start it should start fetching files and if it something else then it should stop.