question Re: Nifi - SFTP and Input Port in Support Questions

Nifi - SFTP and Input Port

justjoe — Mon, 24 Feb 2020 16:00:47 GMT

Hi,

I'm trying to get data from an SFTP server. The recommended pattern from articles I have read

suggest ListFTP to Remote Process Group, Input Port to FetchSFTP.

I'm accessing Nifi on a local instance (localhost:9090/nifi).

After adding a RPG to the canvas as well as an input port, I get the error "Connection refused on the RPG" and "'http://localhost:9090/nifi/' does not have any input ports." when I try connect ListFTP to the Remote Process Group.

Re: Nifi - SFTP and Input Port

stevenmatison — Mon, 24 Feb 2020 13:56:50 GMT

I don’t think the “remote process group” is required. I do however sometimes keep listsftp in main canvas and send to input port of a Process Group(not remote). Only so I can trigger from main canvas and never go into Process Group.

For testing the Sftp connections and basic flow, I would recommend just doing listsftp->fetchsftp directly.

Once you know it works and you still want to move it to different grouping (or even a remote process group) then address moving things around.

Re: Nifi - SFTP and Input Port

MattWho — Mon, 24 Feb 2020 14:59:30 GMT

@justjoe

With Apache NiFi 1.0 - 1.9 versions, only input and output ports added at the root canvas level (very top level) will be "remote" input/output ports. All input/output ports added within sub-process groups are local ports only. NiFi Remote Process Groups (RPG) are only able to send to or pull from "remote" input and output ports.

With Apache NiFi 1.10 and newer you can now have the option of designating an input or output port as either local or remote when it is being added to the canvas within a sub process group.

Hope this helps,

Matt

Re: Nifi - SFTP and Input Port

justjoe — Wed, 26 Feb 2020 11:17:34 GMT

Thanks for the feedback.

I tried, as you suggested, using ListSFTP and FetchSFTP only. I'm still getting a "could not load known_host" error.

Re: Nifi - SFTP and Input Port

justjoe — Tue, 10 Mar 2020 06:44:25 GMT

Solved it.

I had to switch "Strict Host Key Checking" to false.

Works just fine.

Thanks for the help