Skip to main content
narasimha_varma
Silver ⭐️⭐️⭐️
January 9, 2017
Solved

Loading Local Files into HDFS Using Apache NiFi Data Flows

I try to load data from my local system file into HDFS by using Getfile processor in Nifi, but it produces "invalid directory" error11252-screenshot-from-2017-01-09-155052.png

MattWho
MattWhoAnswer
Titanium ⭐️⭐️⭐️
January 9, 2017
@Narasimma varman

Is your NiFi a single instance of NiFi or a NiFi cluster?

If it is a cluster, keep in my mind by default the GetFile processor will be running on every node in that cluster. The validate will also run on every node as well, so make sure the directory exists on all nodes.

Also make sure you have only specified a d directory path in the "Input Directory" property in GetFile. In you case, you should have only "/root/example" for that property.

The filename you wish to pickup should be specified in the "File Filter" property.

Matt

7 replies

MattWho
Titanium ⭐️⭐️⭐️
MattWhoAnswer
Titanium ⭐️⭐️⭐️
January 9, 2017
@Narasimma varman

Is your NiFi a single instance of NiFi or a NiFi cluster?

If it is a cluster, keep in my mind by default the GetFile processor will be running on every node in that cluster. The validate will also run on every node as well, so make sure the directory exists on all nodes.

Also make sure you have only specified a d directory path in the "Input Directory" property in GetFile. In you case, you should have only "/root/example" for that property.

The filename you wish to pickup should be specified in the "File Filter" property.

Matt

Translate
narasimha_varma
Silver ⭐️⭐️⭐️
January 11, 2017

Yes, I am using single instance of Nifi

Translate