question Re: nifi: copy file from one source (Linux Remote source) to other(nifi and hadoop installed) server with use of scp command or alternative way (not site-to-site protocol ) in Archives of Support Questions (Read Only)

nifi: copy file from one source (Linux Remote source) to other(nifi and hadoop installed) server with use of scp command or alternative way (not site-to-site protocol )

paresh_baldaniy — Thu, 04 Jan 2018 13:47:14 GMT

Hey , I want to copy file from Linux Remote machine to hadoop with use of scp command

also i want to pass parameters (server ip , path etc) dynamically

Ex:

scp [options] username1@source_host:directory1/filename1 username2@destination_host:directory2/filename2

Here I will pass all the parameter pass dynamically every time through nifi API

how it is possible ...whether we need to create own processor ?

Thanks ,

Paresh

Wynner — Wed, 10 Jan 2018 05:21:32 GMT

There are already processors designed to make systems calls.

ExecuteProcess -- Runs an operating system command specified by the user and writes the output of that command to a FlowFile.

ExecuteStreamCommand -- Executes an external command on the contents of a flow file, and creates a new flow file with the results of the command.

ExecuteScript -- Executes a script given the flow file and a process session.

I would think the ExecuteProcess would be the best for your use case.