that gets split into individual flowfiles (10 in this case)
I am using FetchSFTP to fetch the file from a sftp location, the content of this fetched file is then split and is processed and stored. In this example: I want to start processing ep.txt only after i have processed bulk.txt after that names.txt and so on.
Thanks for the reply, I cannot use list sftp as it does not allow incoming request hence I have created an execute stream command processor that fetches the list.
I will then feed these list into fetch sftp and then process these files.
I want to fetch these file one by one only after the previous file has processed completely. So far with my implementation the files are picked almost immediately and processed, I cannot use the control rate processor in between because each file has different set of data and have varying processing time