question Re: Ftp sub-directories based on specific file on each sub-directory in Support Questions

Ftp sub-directories based on specific file on each sub-directory

bilel_boubakri — Thu, 20 Jul 2017 15:30:36 GMT

I have a remote directory as an input (containing sub-directories) and i'd like to iterate for each subdirectory and check if a specific file exist, once the last exist i will ftp this sub-directory to local directory using Nifi.

could you please help me on this scenario.

Re: Ftp sub-directories based on specific file on each sub-directory

Wynner — Tue, 25 Jul 2017 07:00:15 GMT

@Bilel Boubakri

Are you saying you want to wait until each sub-directory has a specific file and then start ftping the files to a local directory?

Re: Ftp sub-directories based on specific file on each sub-directory

bilel_boubakri — Wed, 26 Jul 2017 16:12:59 GMT

@Wynner @Matt Clarke @Matt Burgess @Pierre Villard

I want to check each sub-directory once a specific file come like "flag.ok", i start ftping the files

of this sub-directory to a local directory() (always i need to loop all sub-directories

and doing the same job).

Thanks a lot for your support.

Re: Ftp sub-directories based on specific file on each sub-directory

Wynner — Sun, 18 Aug 2019 07:42:32 GMT

@Bilel Boubakri

I am assuming you know how many subdirectories there are in this solution.

ListFTP - scanning the main directory with all the subdirectories

EexcutScript - running a groovy script waiting for all of the flag.ok files to be in the subdirectories

FetchFTP - configured to pull the wanted files

Here is a snapshot of the simple flow:

Here is the sample groovy script for the ExecuteScript processor, configured for this example to wait for 5 files:

def flowFiles = session.get(5)
if(!flowFiles || flowFiles.size() < 5) {
  session.rollback()
} else {
  session.transfer(flowFiles, REL_SUCCESS)
}

waiting-for-5-files-before-ftping-the-files.xml Here is a template of the sample flow