https://community.cloudera.com/t5/Support-Questions/FetchSFTP-failed-to-fetch-all-file-in-the-listSFTP-with-logs/m-p/213839#M175763 <A rel="user" href="https://community.cloudera.com/users/97580/emmaixiato.html" nodeid="97580">@Emma Ixiato</A><P>- </P><P>The list based processors rely on File timestamps to determine if a file should be listed or not. This means that the list based processors may not list files in the target location if:</P><P>-</P><P>1. New files added to source location do not have their timestamp updated. (Thus last recorded timestamp in NiFi from previous listing is newer the age of file that was added)</P><P>2. Multiple files are being written to source location at same time and the list based processor did not list all of them in my execution. Second execution would miss other files because of recorded timestamp from first list execution.</P><P>-</P><P>Not really sure what NiFi version you are running, but here are a few Jiras aimed at making list based processors work much better:</P><P>1. <A href="https://jira.apache.org/jira/browse/NIFI-3332" target="_blank">https://jira.apache.org/jira/browse/NIFI-3332</A> &lt;-- (Addressed as of Apache NiFi 1.4.0)</P><P>2. <A href="https://jira.apache.org/jira/browse/NIFI-4069" target="_blank">https://jira.apache.org/jira/browse/NIFI-4069</A> &lt;-- (Addressed as of Apache NiFi 1.4.0)</P><P>3. <A href="https://jira.apache.org/jira/browse/NIFI-5157" target="_blank">https://jira.apache.org/jira/browse/NIFI-5157</A> &lt;-- (Addressed as of Apache NiFi 1.8.0 being released soon)</P><P>-</P><P>Thank you,</P><P>Matt</P><P>-</P><P>If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link.</P> Sat, 20 Oct 2018 01:05:27 GMT MattWho 2018-10-20T01:05:27Z