Support Questions

Find answers, ask questions, and share your expertise

Move or rename files in ftp server after pull to HDFS with Apache Nifi

avatar
Explorer

Hello Team,

I have scenario below need you help which processor use in apache nifi.

I want to pull near real time files from FTP server and put to HDFS. but after pull files I want to move those files to other path in the same ftp server or rename to new name like (.tmp).

Please help me to design this data flow.

 

Thank

Regards,

 

3 REPLIES 3

avatar

@mala_etl Check out this feature in FetchSFTP:

 

Screen Shot 2022-04-06 at 8.59.34 AM.png

 

It allows you to move the files into a new directory after fetching them.

avatar
Explorer

Hello @steven-matison , Could you provide of value of each properties? 

avatar

@mala_etl Well I cant do all of them,  that would be to your values, not mine, but to achieve the move,  you need to set:


Completion Strategy: Move File

Move Destination Directory:  The directory to move file to

Create Directory:  enable true/ disable false

 

Be sure to check the ? for each property, it will explain everything.