Member since
10-04-2017
2
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1516 | 10-05-2017 12:14 PM |
10-05-2017
12:14 PM
In order to resolve my issue I had to write a bash script to retrieve a listing of the files names from my HDFS folder. That gave me the list of ALL files currently in the directory. I am then able to use the FetHDFS processor to retrieve each of the files by file name.
... View more
10-04-2017
12:36 PM
I'm working on a Nifi process that will retrieve files from HDFS. I'm using the GetHDFS processor to pull all the files from a specific directory. Ideally, I'd like to use an attribute from an XML properties file as the HDFS directory in the event we need to change directories. This would allow us to do that without having to change Nifi. The problem I am having is how to get the GetHDFS processor to recognize the attributes created by my upstream EvaluateXPath processor since GetHDFS does not accept upstream connections. I'm still relatively new to Nifi so I'm completely stumped as to how, if at all, I can get this to work. Any ideas?
... View more
Labels:
- Labels:
-
Apache NiFi