Hi @SAMSAL, thanks a lot for you help. I'm getting data as expected.   ... View more

Hi,   Can you give an example? I think if the url in the flowfile content you can use ExtractText processor where you can create dynamic property and use regex to extract the pattern you need. If the url in an attribute then you can use UpdateAttribute where you can also create dynamic property and use Expression Language function like find(regex) to extract the domain for a given attribute. Example  ${FullUrl.find(regex)}. To set the regex for finding domain from url, checkout this link: https://regex101.com/r/jN6kU2/1     ... View more

Hi, regarding the first point I dont think you can do that through regex, this is more of transformation operation and you might need to use JsonJolt Processor to do transromation first to simplify the json and store all id's in an array then use regular expression to extract the ids. It will complicate matter it might affect performance. What kind of SQL are you using ? Do you have any json functions in that sql? If that is the case I would recommend you deffer this process to SQL and utilize sql function to parse json.  For example in MS SQL you can use OPENJSON function to transpose json into table and then you can use this table in your query. For the second point, this is because the way the extractText reg expression work it treats like group, so beside the main attribute you will get an indexed attribute for each matched group. You can read more about this here: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.5.0/org.apache.nifi.processors.standard.ExtractText/index.html   You can also use this post to see if you can extract one attirbute. I just found about it: https://community.cloudera.com/t5/Support-Questions/Extract-whole-json-flowfilecontent-small-to-single-attribute/m-p/308960   ... View more

@Elsaa  Couple things I would check first. 1. Make sure you do not have two Success relationship connections stacked on top of each other between the "UpdateAttribute" processor and the "CalculateRecordStats" processor.  They processor show 4 in and 12 out which makes be think 4 went to three different success connections.  You can double click on a connection line to add a bend point that would allow you to click and drag that bend point to see if there is another connection under it. 2. If above is not the issue, take a look at the provenance data for your 8 generated FlowFiles to see at what point in your dataflow the clones happened. If you found this response assisted with your query, please take a moment to login and click on "Accept as Solution" below this post. Thank you, Matt ... View more

@Elsaa  Is it a standardized filename structure with a standardized date format? Can you share examples? Thanks, Matt ... View more

Hello SAMSAL, Thank you for your reply. I had a chance to try your solution and it worked as a workaround. Hopefully it can come back to work in next releases my scenario. Best regards... ... View more

I've installed the last version of ni-fi and it solved all problems!  Thank you! ... View more

Hi, What are you trying to do with those attributes? It doesnt make sense that you need to create an attribute for each year value ... View more