Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Is it possible to keep the structure of the uploading local folder the same as HDFS folder with NiFi?

Is it possible to keep the structure of the uploading local folder the same as HDFS folder with NiFi?

New Contributor

Hi there,


I try to upload a big folder from the local computer to HDFS of a remote computer now. I found PutHDFS processor only support to put the local files to a static directory on HDFS. However, the local folder has a nested structure with some files have the same filename. It make the error like filename conflict.

After uploaded the whole folder, all the local files are stored in a flat HDFS directory. The original structure of the folder is broken. My dataflow is shown below. Is it possible to keep the same file structure on HDFS as that of the local folder?

Thank you very much.

110255-1565229033798.png


Kind regards,


Raymond