I am trying to copy files and directories from one HDFS to another HDFS location using NIFI. It is working fine and copying directories and files in case of directory has some files but it is not copying empty directories.
My work flow is: ListHDFS > FetchHDFS > PutHDFS
Example: /tmp/folder1/file1.txt /tmp/folder2 /tmp/folder3/file2.txt /tmp/folder4
folder2 and folder4 are not copied because of empty directories. Do i need to change any processor configurations? Could somebody please point me in the right direction? Thank you
FetchHDFS is to fetch a file, and PutHDFS is to write a file... so if there is a directory with no files then there is nothing to fetch or put.
Thanks for your response @Bryan Bende
Do we have any workaround for this or any other workflow with different processors? Basically i want to move all these folders and files including empty folders to some other directory.