Trigger GetSFTP processor

Question

I am using GetSFTP processor to get files from Filezilla and PutFile processor to move the file to a directory in my local

machine.

Is there a way to trigger GetSFTP processor every time a new file is uploaded.?

I am trying to create a flow where - every time a new file is uploaded to the server I want it automatically downloaded to my local machine. Can this be done using nifi.?

Thanks.

Shu_ashu · Accepted Answer

@ShailukSchedule GetSFtp processor to run on Primary node with Run Schedule as 0 Sec then processor will try to run everypossible sec and pulls the file from configured directory.**NOTE**if we don't delete the file from the path then GetSFTP processor will pull the same file again and again because GetSFTP processor doesn't store the state.Correct Approach:Use ListSFTP + FetchSFTP processors and configure ListSFTP processor to run on primary node with Run schedule as 0 sec and this processor stores the state and runs incrementally by listing out only the newly added files in the directory.FetchSFTP processor fetches the files from the directory and then use PutFile processor to store the files into Local machine.

shailuk · Answer

@ShuI am able to connect to the server using Filezilla but unable to connect using ListSFTP processor. I get this error - Here are my configurations - Is it because Private Key Property is blank.? If yes, can you please tell what has to be done. The pem file is in my desktop (local machine). I gave the path to it but it says it invalid. Thanks.

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.