Copy Folders with Nifi

[#1]

Is there a way to copy and retain recursive folder structure using Nifi? I am able to copy individual files, but it would be great to be able to copy subfolders.

[#2 · Accepted solution]

@David Williamson

If you are using GetFile and PutFile processors to copy individual files, they can also be used for recursive folder structure.

One of the attributes written by GetFile is the folder path of the file, so you can use PutFile to create the folder structure in the new location.

[#3]

@David Williamson

Yes, the ListFile writes the same attributes. But, make sure the user running NiFi has the permissions to create directories in HDFS.

[#4]

Sorry, I should have clarified this some more. I am currently using ListFile, FetchFile, and PutHDFS. Do the same settings apply?