question Re: Read files from SFTP server and put file in back using sftp in apache NIFI in Support Questions

Read files from SFTP server and put file in back using sftp in apache NIFI

enam — Thu, 11 Jan 2024 10:10:33 GMT

Dear Sir,

I am using apache nifi for

Getting file from SFTP server
Backup files another SFTP server
Delete the all files from where getting locations
process file to call invokeHttp Request

SFTP images using winscp:

After login folder locations:

1. Here is the diagram:

2. ListSFTP properties:

3. FetchSFTP properties

3. Put SFTP properties

I follow processors bellow sequences:

ListSFTP--> FetchSFTP-->PutSFTP-->UpdateAttribute --> InvokeHttp

I did not get file from sftp server.

What is the wrong of my configuration?

Re: Read files from SFTP server and put file in back using sftp in apache NIFI

Elnozy — Thu, 11 Jan 2024 14:01:08 GMT

@enam, have you check the state of the ListSFTP processor (action "view State")?

With the listing strategy equals "Tracking timestamp", the processor save the last time it checks the SFTP folder and don't retrieve older files than this timestamp.

Re: Read files from SFTP server and put file in back using sftp in apache NIFI

MattWho — Thu, 11 Jan 2024 21:41:42 GMT

@enam

Looks like you have a bad file filter regex in your listSFTP processor configuration.

.*file.*\.xls

Above looks for any character for 1 or more characters until is finds the last occurrence of string "file" followed by any character for as many characters until last occurrence of string ".xls". However, all your filenames start with "file" and have no characters before it.

Try modifying your file filter regex by removing the ".*" before "file":

file.*\.xls

Right click on processor, select "view state", and then "clear state". Then start the listSFTP processor again to see if generated NiFi FlowFiles for each file on your SFTP server.

If you found any of the suggestions/solutions provided helped you with your issue, please take a moment to login and click "Accept as Solution" on one or more of them that helped.

Thank you,
Matt