question Re: Urgent need for ListSFTP & FetchSFTP working example in Archives of Support Questions (Read Only)

Urgent need for ListSFTP & FetchSFTP working example

sahaavish — Sun, 18 Aug 2019 11:12:22 GMT

I have been struggling with ListSFTP and FetchSFTP (PFA) as none of them seem to be working and ending up with error below -

java.io.FileNotFoundException: Could not perform listing on /home/temp/ because could not find the file on the remote server

ListSFTP

FetchSFTP

Re: Urgent need for ListSFTP & FetchSFTP working example

andrewg — Thu, 22 Dec 2016 02:24:29 GMT

Setting a remote file to /home/temp/ is wrong. It expects a filename, not a directory. A combination of ListSFTP and FetchSFTP will ensure the filenames are passed to the FestSFTP via a known attribute name.

Here's an example template from the gallery: https://github.com/hortonworks-gallery/nifi-templates/blob/master/templates/List_and_Fetch_SFTP_template.xml

Re: Urgent need for ListSFTP & FetchSFTP working example

sahaavish — Thu, 22 Dec 2016 02:38:57 GMT

Thanks @Andrew Grande for the quick response. The problem however is with ListFile above, as you can see I have specified the path /home/temp to the 'Remote Path', should that not first enlist all the files in that directory, which then I believe will be sent over to FetchFile as flowfile, right?

Re: Urgent need for ListSFTP & FetchSFTP working example

andrewg — Thu, 22 Dec 2016 02:49:34 GMT

You removed all details from the configuration. Do you have the 'temp' user? Which user do you use for SFTP login? Normally you wouldn't have access to other users' home directories. Try using a directory outside of /home and set correct permissions on it.

Re: Urgent need for ListSFTP & FetchSFTP working example

bbende — Thu, 22 Dec 2016 04:01:02 GMT

Shouldn't the FetchSFTP Remote File be set to ${path}/${filename} which are the attributes produced by ListSFTP?

Re: Urgent need for ListSFTP & FetchSFTP working example

sahaavish — Fri, 23 Dec 2016 13:38:46 GMT

@Andrew Grande & @Bryan Bende, you guys ROCK!!! It was actually a permissions issue which I fixed. Thank you, appreciate it.

Re: Urgent need for ListSFTP & FetchSFTP working example

hemamoger — Fri, 09 Mar 2018 16:02:57 GMT

@Andrew Grande

I have the same issue but for the GETSFTP processor .Filenotfound exception.

screenshot-from-2018-03-09-13-24-26.png