Support Questions
Find answers, ask questions, and share your expertise

Nifi FetchSFTP changes the order of files in queue

New Contributor

I am using ListSFTP and then FetchSFTP to pull data from SFTP server. The ListSFTP outputs the file in following order in the queue

file_A.xml

file_B.xml

However, FetchSFTP changes the order of flow files when it downloads the file.

file_B.xml

file_A.xml

Is there any way to ensure that the order of flow files in the queue doesn't get changed?

2 REPLIES 2

Super Guru
@Manoj

I think as soon as fetch completed then FetchSFTP processor outputs the flowfile, in your case file_B.xml fetch finished first that file_A.xml fetch.

You can use EnforceOrder processor after FetchSFTP processor to keep your source orders as is.

Refer to this link for more details regards to usage/configuring EnforceOrder processor.

-

If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues.

New Contributor

I have Concurrent Tasks=1 configured. My assumption is that FetchSFTP will attempt to download one file at a time based on the input queue order. Even in this case does FetchSFTP attempt to pull file in parallel?

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.