Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 09-14-2023 04:21 AM
I have a nifi flow, working fine. It picks file from a source directory, processes it, and file is deleted from source directory once picked up.
This all works fine first time. But later on, if I copy another file in source directory, that file is not picked up. I even stop all processors, clean any queue if not empty, and restart processors, but still file is not picked from input directory.
What causes this behaviour?
As a result, I have to stop-restart nifi, making it a bit cumbersome.
PS: Based on some google suggestions, I tried to delete flowfile_repository, but it doesn't allow so with message 'Device or resource busy'.
Created on 09-14-2023 04:41 AM - edited 09-14-2023 04:41 AM
Got the answer. First processor has listing strategy set to 'Tracking Timestamps', and copied file has older timestamp than the latest tracked one.
Created on 09-14-2023 04:41 AM - edited 09-14-2023 04:41 AM
Got the answer. First processor has listing strategy set to 'Tracking Timestamps', and copied file has older timestamp than the latest tracked one.
Created 09-14-2023 09:55 AM
@manishg
Copying a file should have resulted in a new timestamp making it newer than the last file you previously listed. However, moving a file typically does not change timestamps on the file. My guess here is you moved a file into the directory instead of copy?
Matt
Created 09-14-2023 07:24 PM
I used docker copy command.
Created 09-14-2023 08:17 AM
What processors are you using? List or Get files?
Created 09-14-2023 07:25 PM
Its ListFile.