I am using ListSFTP and then FetchSFTP to pull data from SFTP server. The ListSFTP outputs the file in following order in the queue
However, FetchSFTP changes the order of flow files when it downloads the file.
Is there any way to ensure that the order of flow files in the queue doesn't get changed?
I think as soon as fetch completed then FetchSFTP processor outputs the flowfile, in your case file_B.xml fetch finished first that file_A.xml fetch.
You can use EnforceOrder processor after FetchSFTP processor to keep your source orders as is.
Refer to this link for more details regards to usage/configuring EnforceOrder processor.
If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues.
I have Concurrent Tasks=1 configured. My assumption is that FetchSFTP will attempt to download one file at a time based on the input queue order. Even in this case does FetchSFTP attempt to pull file in parallel?