NiFi: How to connect to a GetFile Processor?

[#1]

I have a flow that uses an ExecuteStreamCommand processor to populate a folder with some data.

The actual flow files are essentially just arguments to a script that eventually generates some output.

When the script is done, I want to go pick up the output using GetFile or FetchFile, and then continue some further processing.

However, I can't seem to connect my ExecuteStreamCommand processor to a GetFile or FetchFile processor. The GUI simply won't allow it.

Can anyone straighten me out here?

Is there some reason that what I'm trying to do is invalid?

Is there a better way to accomplish this?

[#2 · Accepted solution]

You could use ListFile in a separate flow, it will keep track of the files it has listed so far, such that if your ExecuteStreamCommand generates more files in the specified location(s), only the new files will be listed the next time ListFile runs. Then ListFile can be routed to FetchFile to get the contents of the new files, etc.

[#3]

Thanks.

I landed at a similar solution using GetFile.