- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Bug? NiFi ListFile processor works only one time after I change its configuration
- Labels:
-
Apache NiFi
Created ‎06-23-2017 12:38 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have set up a simple flow in NiFi 1.1.2:
- ListFile -> (success) -> FetchFile
- ListFile reads /vagrant/testData folder. Running on primary NiFi node only. I have not changed any different settings than these two (directory to observe, execution scheduling)
- FetchFile moves the file to /vagrant/testData2. That's all.
To reproduce the bug(?):
- Start the flow, do not have any files in the input directory
- Put a file into input directory
- File will be moved as expected -- this is correct behavior so far
- Move another file into the directory (different file name)
- You can wait 5 minutes, but the file will not be found by the ListFile processor anymore
- Stop ListFile processor
- Change a setting, for example "Recurse Subdirectories" to false
- Start ListFile processor again
- The second file you put into the input directory will now be moved to output directory
- Put a third file into the input folder --> nothing will happen again.
Is this a known issue? How to fix it?
Created ‎06-23-2017 12:59 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Here is a link to another question about the ListFile processor. I think you might be seeing the same behavior. ListFile processor
Created ‎06-23-2017 12:59 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Here is a link to another question about the ListFile processor. I think you might be seeing the same behavior. ListFile processor
Created ‎06-23-2017 01:15 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks for the quick input - my question got resolved by the link you added. @Matt Clarke writes: "A move operation typically does not update the timestamp, but a copy will.". For my system on Ubuntu 14.04, I need to change the content of the files (i.e. with gedit).
When I solely copy the file in a different folder, rename it, copy with ctrl+c and paste it into the input directory with ctrl+v, the ListFile processor will not list the added file. It works when the file is changed. I guess this behavior should only occur when testing the processor with the same static file like I did...
