Hi, I'm only able to do that via two processors: 1- JotlTransfomJSON : this is to add desired attributes (attr_id & attr_name) to the flowfile json using the following spec:   [ { "operation": "shift", "spec": { "#${attr_id}":"attr_id", "#${attr_name}":"attr_name", "model": "model", "cars_drivers": { "*": { "id": "cars_drivers[#2].id", "name": "cars_drivers[#2].name", "is_processed": "cars_drivers[#2].is_processed" } } } } ]   2 - UpdateRecord Processor: Once the attributes are added to the Json , you can update those records Is_processed value only when the id matches the attr_id and name matches the attr_name. To do that set the following properties:      a- Replacement Value Strategy: Literal Value      b- /cars_drivers[*]/id[.=../../../attr_id]/../name[.=../../../attr_name]/../is_processed : 1   Hope that helps, if it does please accept solution.   ... View more

Hi ,   Can you provide examples of the different json input? ... View more

Hi, Try the following Jolt spec:   [ { "operation": "shift", "spec": { "tags": { "*": { "tag": "tags.[#2].Parameter", "value": "tags.[#2].value" } } } } ] If you find this helpful please accept solution. ... View more

Hi, I dont think it matters which system the path is located as long you have access to it. Do you have access to the path \\10.1.1.35\nifi from the machine where nifi is deployed? I'm not Linux expert but you need to test if the path with the file name is accessible by doing some system command or trying to access via file explorer.   ... View more

Hi,   Have you looked into the ControlRate processor. Its not exactly doing what you want but it allows you to put a time to hold a flowfile before it gets released to the next processor. For example if you think that you need a second to process one flowfile from the moment its fetched to the moment its processed by PutKudu, then you can configure the ControlRate as follows:   ... View more

Hi, Please try the following spec: [ { "operation": "shift", "spec": { "timestamp": { "*": { "@(2,resourceid)": "[&1].resourceid", "@": "[&1].timestamp" } }, "Key": { "*": { "@": "[&1].key" } }, "data": { "*": { "@": "[&1].data" } } } } ] If you find this helpful, please accept solution. Thanks ... View more

Hi, Is your input in Json format? if its json do you need to completely replace it with the output you specified? If that is the case then you dont need Jolt transformation, instead you can do the following: 1- Place the Gallery_Ids attribute as flowfile content. You can do that using the ReplaceText processor where the Replacement Value is the attribute ${GALLERY_IDS} 2- Do SplitJson to split the Array into a different flow file, this should give 7 flowfiles with the values: 1,2,3,4,5,6 & 7 3- Add another ReplaceText processor that will capture each split from above and replace the flowfile content with the following template in the Replacement Value: {"GALLERY_ID":"$1","PERSON_ID":"test$1"} Leave the Search Value as (?s)(^.*$) This should again give you 7 flowfiles with the expected output format.   Hope that helps, if it does please accept solution. Thanks ... View more

hmmm, you are right! the ValidateXML processor only accepts variables from the variable registry as noted in the Schema File property description. @MattWho , @araujo do you know why is this the case for the ValidateXML and what would be the proper solution? The only way I can think of in this case is updating the variable in the variable registry through the API to assign the proper value to the schema.name variable: https://stackoverflow.cm/questions/52010827/how-to-change-nifi-variable-registry-using-rest-api   ... View more

Hi,   To answer your question, it depends: 1- If the attribute value that on the xml flowfile can be used to derive the XSD file name\path then you can use Expression Language to construct the XSD file name from the attribute value when assigning the "Schema File" property. For example if all XSD have the following filename format [SomeID]_XSD_File.xsd and the attribute "Id_Attribute" has the ID then the "Schema File" property can be set to: ${Id_attribute:append('_XSD_File.xsd ')}   2- If the xsd file name cant be derived through the attribute value and you have to do some If-Else conditions based on the attribute then you can use ExecuteScript processor do that and set new flowfile attribute with the xsd file schema path. To learn how to use the ExecuteScript to add new attribute based on some custom code you can check the "Recipe: Add an attribute to a flow file" under: https://community.cloudera.com/t5/Community-Articles/ExecuteScript-Cookbook-part-1/ta-p/248922   3- If you dont want to use ExecuteScript processor, you can utilize the UpdateAttribute Processor by creating different Rules, Conditions & Actions to set a File Schema attribute that can be used in the ValidateXML File Schema property. To learn how you can create different rules , condition & action please check the following tutorial: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-update-attribute-nar/1.5.0/org.apache.nifi.processors.attributes.UpdateAttribute/additionalDetails.html   Hope that helps, if it does please accept solution. Thanks   ... View more

Hi, I'm not sure if you can use Regex in jolt transformation,  but you can use wildcard (*) instead. Keep in mind even with Regex you still need to find the common denominator for each attribute to be able to match, so wildcard should suffice. To use the wildcard you can apply something like this to your spec:   [ { "operation": "shift", "spec": { "my_id": "my_id", "my*company*sa": "my_company_sa", "*RH": "my_company_rh" } } ]  Hope that helps, if it does please accept solution. Thanks ... View more

Hi, To help you I think we need to understand your question better, so you have a json input like you specified above, from what I understand there are two parts you are trying to solve: 1- You need to process this json if it meets certain condition, in this case the condition is if the Json attribute "dataSourceName" is equal to "Standard CPU Utilization Network Cisco". 2- If the json meets the condition above then you want to apply Json Jolt Transformation to produce the output you specified, is this correct?   To answer the first part, I'm not sure if you can have conditional json jolt so you can do the first and the second part in one processor. I think what you need to do is use EvaluateJsonPath processor to extract the value that you need  -dataSourceName- into a flow file attribute then use RouteOnAttribute to check the value so that if meets the condition (="Standard CPU Utilization Network Cisco" ) the match relationship will direct the flow file to the Jolt transformation processor to apply needed transformation , otherwise the flowfile will be dropped or direct to unmatched relationship for farther processing.   For the second part, its not clear if you need the exact output you specified no matter what the other  values in the input json are , which in this case you can use the ReplaceText processor just to replace the whole input json with the expected out, Or you actually need json jolt transformation to capture different values for each json input which in this case its not clear how you are selecting your values, for example on what basis you decided that the value of "Datapoints" is "MemoryFree", also how the attribute "Datas" has the value of "Values[3]". So you need to clarify that better so we can help you with creating the proper jolt spec.   Hope that helps. Thanks             ... View more

Hi, you can use the flowfile size attribute "fileSize" to check for the size. for example if you want to process flowfile from S3 that has contents you can create new property in the RouteOnAttribute processor with the following EL: ${fileSize:gt(0)} If you find this helpful, please accept solution. Thanks   ... View more

Hi ,   where is the key,value pair are stored? Are they stored as a flowfile attribute or in the input json? there are processors like RouteOnAttribute in case they are stored as attributes where you can create your condition as dynamic property and provide the logical expression there. If the key\value pair is part of the json you can use Extract Text to Extract the key\value pair as an attribute then use RouteOnAttribute or you can try to use RouteOnContent if that will work?   If you find this helpful, please accept solution. Thanks Samer ... View more

Hi , Not sure if this is possible with out of the box processor. I can think of ReplaceText first to replace different delimiters like (-) or white-space (\s) to common delimiter like (,) however if there is a white space before or after other delimiters like (-) or (,) its not going to work. Another option is to use ExecuteScript processor where you try to read each line (after the header) from the flowfile content and then use string split function and try it with different delimiter, once you get two array elements you construct your new string with the new column header and delimiter and transfer to the success relationship. ... View more

Hi, You can use the ReplaceText Processor as follows: If you find this helpful please accept solution. Thanks ... View more