Read files from SFTP server and put file in back using sftp in apache NIFI

Question

Dear Sir,I am using apache nifi for  Getting file from SFTP serverBackup files another SFTP serverDelete the  all files from where getting locationsprocess file to call invokeHttp RequestSFTP images using winscp:After login folder locations:  1. Here is the diagram:2. ListSFTP properties:3. FetchSFTP properties3. Put SFTP propertiesI follow processors  bellow sequences: ListSFTP--> FetchSFTP-->PutSFTP-->UpdateAttribute --> InvokeHttpI did not get file from sftp server. What is the wrong of my configuration?

MattWho · Accepted Answer

@enam

Looks like you have a bad file filter regex in your listSFTP processor configuration.

.*file.*\.xls

Above looks for any character for 1 or more characters until is finds the last occurrence of string "file" followed by any character for as many characters until last occurrence of string ".xls". However, all your filenames start with "file" and have no characters before it.

Try modifying your file filter regex by removing the ".*" before "file":

file.*\.xls

Right click on processor, select "view state", and then "clear state". Then start the listSFTP processor again to see if generated NiFi FlowFiles for each file on your SFTP server.

If you found any of the suggestions/solutions provided helped you with your issue, please take a moment to login and click "Accept as Solution" on one or more of them that helped.

Thank you,
Matt

Elnozy · Answer

@enam, have you check the state of the ListSFTP processor (action "view State")?

With the listing strategy equals "Tracking timestamp", the processor save the last time it checks the SFTP folder and don't retrieve older files than this timestamp.

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.