question Re: Using regular expression on flowfilename to update Attribute in Support Questions

Using regular expression on flowfilename to update Attribute

simon_jespersen — Thu, 12 Oct 2017 19:33:37 GMT

Hello,

I am ingesting files with

names like

I_XXX_20171002024210_LU2016DKABCDE12345-2017-10-02-TESTDAC2-000003_xxxxxxx.json

I_SSSSS_20171003024653_US2016US3661159602CC8FC7-4963-4304-A211-D8BCDA152625_xxxxxxx.json

I want to update/set a flowfile attribute using regular expression on the filename

Is there a nifi expression language function that support that.

ie. ${filename:<regexec:()>}

This regular expression extract the date yyyymmdd in capture group #2 from the filename

\_([A-Za-z]{3,5})\_([0-9]{8}).*xxxxxxx.json

Shu_ashu — Sun, 18 Aug 2019 02:45:33 GMT

Can you once try using the below methods to change the filename

1.by using replaceAll string manupulation and adding the filename property as

${filename:replaceAll('.*\_([A-Za-z]{3,5})\_([0-9]{8}).*xxxxxxx.json','$2')}.json

2.another way is using getdelimited Manupulation

by adding filename property as

${filename:getDelimitedField(3, '_'):substring(0,8)}.json

Both ways results the same output you can choose the best way which will fits for your case.

Output:-

simon_jespersen — Thu, 12 Oct 2017 20:11:38 GMT

@Shu Thank you so very much for that really good answer.

ahadjidj — Sun, 18 Aug 2019 02:45:14 GMT

You can use UpdateAttribute and create a new attribute with the following EL : ${filename:getDelimitedField(3,'_')}