Member since
03-28-2017
2
Posts
0
Kudos Received
0
Solutions
03-30-2017
12:28 AM
Thanks for the advice Matt. Let me preface this by saying I'm completely new to Nifi. After looking at the source code for ListFile processor, I've got some questions about implementing WatchFile: Would it be ideal if I were to do something similar to ListFile? I.E. I would extend AbstractListProcessor<FileInfo> instead of AbstractProcessor itself. I would implement my own version of performListing with the WatchServiceAPI along with the other functions from AbstractListProcessor that I would need to override, and let the AbstractListProcessor generate the Flow Files? Thanks for your help.
... View more
03-28-2017
10:25 PM
Hello There, I have a simple workflow that looks like: ListFile -> FetchFile -> PutHDFS This workflow is used to update a directory on HDFS based on a windows share directory. ListFile seems to get the job done when a new file is added or an existing file is updated, but it doesn't seem to handle the case where a file is removed from the source directory. Is there an existing processor that does this? Or is this something that I have to implement a custom processor for? I.e. I'm trying to delete files on HDFS based on what gets deleted in a windows share directory. Is there something that already does this or do I need to write a custom processor? Thanks for your help.
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache NiFi