Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Move or rename files in ftp server after pull to HDFS with Apache Nifi

avatar
Explorer

Hello Team,

I have scenario below need you help which processor use in apache nifi.

I want to pull near real time files from FTP server and put to HDFS. but after pull files I want to move those files to other path in the same ftp server or rename to new name like (.tmp).

Please help me to design this data flow.

 

Thank

Regards,

 

3 REPLIES 3

avatar

@mala_etl Check out this feature in FetchSFTP:

 

Screen Shot 2022-04-06 at 8.59.34 AM.png

 

It allows you to move the files into a new directory after fetching them.

avatar
Explorer

Hello @steven-matison , Could you provide of value of each properties? 

avatar

@mala_etl Well I cant do all of them,  that would be to your values, not mine, but to achieve the move,  you need to set:


Completion Strategy: Move File

Move Destination Directory:  The directory to move file to

Create Directory:  enable true/ disable false

 

Be sure to check the ? for each property, it will explain everything.