question Re: How to get files two hours ago in FTP file system，thanks in Support Questions

How to get files two hours ago in FTP file system，thanks

zhangliang — Thu, 20 Jan 2022 12:35:11 GMT

how to use ListFTP and FetchFTP processors get all files two hours before the current time in FTP server.

There will be more and more files in the FTP server named by date

These filename in the FTP contains a date as follows:

xxxx-xxxx-xxxx-xxxx-20211231143000-xxxx-xxxx.csv

xxxx-xxxx-xxxx-xxxx-20211231153000-xxxx-xxxx.csv

......

Re: How to get files two hours ago in FTP file system，thanks

DigitalPlumber — Thu, 20 Jan 2022 18:58:23 GMT

Have you considered looking at the ListFtp property:

Minimum File Age and set it to 2 hours

Re: How to get files two hours ago in FTP file system，thanks

zhangliang — Fri, 21 Jan 2022 01:08:59 GMT

I know the ListSftp processor have 'Minimum File Age' property, but the ListFtp have not 'Minimum File Age' property, do you know how to add 'Minimum File Age' property in ListFtp properssor. thanks!

when i add 'Minimum File Age' in ListFTP processor, it not work, like this:

it displays 'Minimum File Age' is not a supported property or has no Validator associated with it

Re: How to get files two hours ago in FTP file system，thanks

DigitalPlumber — Fri, 21 Jan 2022 17:50:18 GMT

Without knowing how the FTP directory is populated, you might have an issue with the ListFTP state and might consider changing its its Listing Strategy,

However assuming that is no issue and you want to only perform an action based on any file with a naming structure like this: xxxx-xxxx-xxxx-xxxx-20220121110000-xxxx-xxxx.csv and only if it is older than two hours from "now"

I would run the output of your ListFTP to an UpdateAttribute and add these 2 properties:

property name

fileTime

value

${filename:getDelimitedField(5,'-'):trim():toDate('yyyyMMddHHmmss'):toNumber()}

property name

timeNow

value

${now():toNumber():minus(7200000)}

Then route that to a RouteOnAttribute and add a new property:

property name value

2 hours old ${fileTime:le(${timeNow})}

Then you can drag that connection to follow on processing and the unmatched connection to other processing or terminate it.

Explanation:

filelName

${filename:getDelimitedField(5,'-'):trim():toDate('yyyyMMddHHmmss'):toNumber()}

This grabs the time out of your filename and converts it to a Date object so it can be converted to its epoch representation

timeNow

${now():toNumber():minus(7200000)}

Sets a value 2 hours ago from current time

${fileTime:le(${timeNow})}

If attribute fileName is less than or equal to timeNow it means that it is 2 hours old.