Create files from GetHDFS processor flowfiles

[#1]

Hello,

i would like to create a Nifi flow that parses a number of files from HDFS with GetHDFS processor, creates a separate file for each incoming flowfile from HDFS with the same name but different extension and finally write both the original HDFS file and the newly created file to a remote location via FTP. Which Nifi processor would be suitable for this task?

The flow i imagine is as following:

GetHDFS ----> *Nifi processor* --> PutFTP

[#2]

I would love to make this flow complicated.

> What if one putftp is success and another one failed. 🙂 do u want one to be success and other failed . or do you want to handle it like a retry

[#3]

Interesting, definitely the latter i would like to handle it as a retry. The files should be transfered only in pairs, how would you approach it?

[#4]

One more point use listHDFS and putHDFS than getHDFS . If you are using TDE then there is a bug in getHDFS which can happen in rare scenarios.

[#5]

Hi @Shu i ve posted a new question here, hope what i am trying to do in this use case is clear!