Nifi SFTP Mutiple Files into Mutiple HDFS directories (Based on file name)

[#1]

Trying to move files via Nifi using GetSFTP. Let's say the filename is "DATA1". I want to move DATA1 into HDFS directory DATA1. I also want to do this with DATA2, DATA3, etc... How would this be possible via Nifi without creating a process for each file?

[#2 · Accepted solution]

Use expression language in PutHDFS for the value of the Directory property, so setting it to ${filename} would put each file into a directory named the same as the filename attribute of each flow file in NiFi.

[#3]

Thanks, this is exactly what I'm looking for!

[#4]

@Joe Petro

Yes this is very doable...

NiFi automatically creates a FlowFile Attribute called "filename" on every FlowFile that is created. You can use this existing attribute to specify teh target HDFS directory:

Of course you will want to modify the above for the complete target path.

Thanks,

Matt