question Re: how to get files based on the time stamp in Nifi? in Archives of Support Questions (Read Only)

how to get files based on the time stamp in Nifi?

iyappan — Tue, 07 Jun 2016 16:16:07 GMT

Please explain how to get files based on time stamp?
How to list a set of files not as (.xls and xlsx) files ie.other than .xls and .xlsx fiiles

Re: how to get files based on the time stamp in Nifi?

pvillard — Tue, 07 Jun 2016 16:20:56 GMT

If your files are located on local file system you may use ListFile processor. This processor has properties accepting the use of expression language. Using date functions of expression language [1], you can filter the files you list based on the timestamp (if the filenames contain timestamp).

Regarding your second question, you can use the File filter property in ListFile processor which accepts a regular expression. It allows you to exclude some extensions if you don't want to list .xls and .xlsx files.

[1] https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#dates

Re: how to get files based on the time stamp in Nifi?

iyappan — Tue, 07 Jun 2016 17:54:12 GMT

Thanks@ Pierre Villard

I'm using Windows Nifi how to list files using time stamp...

in File filter we the default as [^\.].* . we can change * as which ever file format but suppose i don't want .xls file. how can i apply not in [^\.].xls.

Re: how to get files based on the time stamp in Nifi?

pvillard — Tue, 07 Jun 2016 18:12:11 GMT

- I don't understand what is the problem with Windows. Do your files contain timestamps in the filename? If yes, you can use regular expression to filter on the filename based on the date.

- If you want all files having an extension but with the extension not being equal to .xls or .xlsx, you can use the following regular expression:

^.*\.(?!xls$|xlsx$)[^.]+$

I would recommend you testing your regular expressions on this website : http://regexr.com/

This site provides a "explain tab" giving information regarding the regular expression and how it works.

Re: how to get files based on the time stamp in Nifi?

iyappan — Tue, 07 Jun 2016 19:27:47 GMT

Hi@Pierre Villard

This (^.*\.(?!xls$|xlsx$)[^.]+$) operators is not working for me..it doesn't list any files. in my directory having two excel files and 1 .txt file and .xml file but it not list any....

Re: how to get files based on the time stamp in Nifi?

pvillard — Mon, 19 Aug 2019 10:15:44 GMT

This works for me.

Re: how to get files based on the time stamp in Nifi?

iyappan — Wed, 08 Jun 2016 13:44:18 GMT

now working...

Thanks

Iyappan