question Re: Copy Folders with Nifi in Archives of Support Questions (Read Only)

Copy Folders with Nifi

david_j_william — Mon, 25 Sep 2017 21:21:47 GMT

Is there a way to copy and retain recursive folder structure using Nifi? I am able to copy individual files, but it would be great to be able to copy subfolders.

Re: Copy Folders with Nifi

Wynner — Mon, 25 Sep 2017 21:42:18 GMT

@David Williamson

If you are using GetFile and PutFile processors to copy individual files, they can also be used for recursive folder structure.

One of the attributes written by GetFile is the folder path of the file, so you can use PutFile to create the folder structure in the new location.

Re: Copy Folders with Nifi

david_j_william — Mon, 25 Sep 2017 21:55:28 GMT

Sorry, I should have clarified this some more. I am currently using ListFile, FetchFile, and PutHDFS. Do the same settings apply?

Re: Copy Folders with Nifi

Wynner — Mon, 25 Sep 2017 22:01:50 GMT

@David Williamson

Yes, the ListFile writes the same attributes. But, make sure the user running NiFi has the permissions to create directories in HDFS.