question how to copy files from local desktop lo hdfs location using NiFi? in Archives of Support Questions (Read Only)

how to copy files from local desktop lo hdfs location using NiFi?

Former Member — Thu, 25 Aug 2016 21:39:20 GMT

Re: how to copy files from local desktop lo hdfs location using NiFi?

MattWho — Mon, 19 Aug 2019 10:39:40 GMT

The simplest answer to your question is to use the ListFile processor to produce a list of the files from your local filesystem, feed that to a fetchFile processor that will pickup the content and then pass them to a PutHDFS processor to send them to your HDFS. The listFile processor will maintain state based on lastModified time on the files to ensure the files are not listed more then once.

If you right click on either of these NiFi processors you can select "usage" from the displayed context menu to get more details on the configuration of each of these.

Thanks,

Matt

Re: how to copy files from local desktop lo hdfs location using NiFi?

sunile_manjee — Thu, 25 Aug 2016 21:58:59 GMT

@kishore sanchina you will need to use a protocol. If you simply want to "push" local files to nifi, you can use the ListenHTTP processor. Then simply curl the file to nifi.