I think everything works fine, the json flowfiles are the response of an invokeHttp request to an API, I receive more than 5000 flowfiles, each flowfile contains 200 records. Problems happen only with 4 files that contain the ETX symbol. ... View more

Hi, I'm only able to do that via two processors: 1- JotlTransfomJSON : this is to add desired attributes (attr_id & attr_name) to the flowfile json using the following spec:   [ { "operation": "shift", "spec": { "#${attr_id}":"attr_id", "#${attr_name}":"attr_name", "model": "model", "cars_drivers": { "*": { "id": "cars_drivers[#2].id", "name": "cars_drivers[#2].name", "is_processed": "cars_drivers[#2].is_processed" } } } } ]   2 - UpdateRecord Processor: Once the attributes are added to the Json , you can update those records Is_processed value only when the id matches the attr_id and name matches the attr_name. To do that set the following properties:      a- Replacement Value Strategy: Literal Value      b- /cars_drivers[*]/id[.=../../../attr_id]/../name[.=../../../attr_name]/../is_processed : 1   Hope that helps, if it does please accept solution.   ... View more

Thanks for the reply, it worked 🙂  Also, I got the expected output and didn't see the `MapRecord` as displayed in your output   Thanks! ... View more

How did anyone solve this issue? I was currently trying to solve similar issue via nifi api (Postman) ... View more

Input 1 "npi_code": "NEW", "cifa_category": "XM", "o9_category": "Accessories", "equipment_type": "AC", "equipment_sub_type": "CASEPROT", "model_manf": "137181-1050", "model_comcast": "Samsung Galaxy A51 Presidio Grip", "memory": "", "color": "Black", "os": "", "upc": 849000000000, "sku": 849000000000, "cifa_id": 273271, "manufacturer_part": "137181-1050", "description": "Speck Samsung Galaxy A51 Presidio Grip - Black", "uom": "", "manufacturer": "SPK", "serialized": "N", "equip_id_type": "ICCID", "pre_inserted_sim": "", "sim_type": "", "sim_form": "", "base_feature_tier": "", "market_attractiveness": "", "memory_tier": "", "size_tier": "", "planning_item": 848709087461, "stat_item": "Samsung Galaxy A51 Presidio Grip", "model_mem": "Samsung Galaxy A51 Presidio Grip", "model_mem_color": "Samsung Galaxy A51 Presidio Grip", "hero_status": "", "launch_date": "2020-05-08", "dummy_item_creation_date": "", "npi_announcement_date": "", "pre_order_date": "", "ga_date": "", "landed_at_launch_date": "", "planned_end_of_purchase": "", "planned_end_of_replen": "", "planned_end_of_forecast": "", "independence_date": "", "disable_date": "2021-04-29", "accessory_retail_end_of_life": "" }   Input 2 { "Item": [ { "npi_code": "NEW", "cifa_category": "XM", "o9_category": "Accessories", "equipment_type": "AC", "equipment_sub_type": "CASEPROT", "model_manf": "137181-1050", "model_comcast": "Samsung Galaxy A51 Presidio Grip", "memory": "", "color": "Black", "os": "", "upc": 849000000000, "sku": 849000000000, "cifa_id": 273271, "manufacturer_part": "137181-1050", "description": "Speck Samsung Galaxy A51 Presidio Grip - Black", "uom": "", "manufacturer": "SPK", "serialized": "N", "equip_id_type": "ICCID", "pre_inserted_sim": "", "sim_type": "", "sim_form": "", "base_feature_tier": "", "market_attractiveness": "", "memory_tier": "", "size_tier": "", "planning_item": 848709087461, "stat_item": "Samsung Galaxy A51 Presidio Grip", "model_mem": "Samsung Galaxy A51 Presidio Grip", "model_mem_color": "Samsung Galaxy A51 Presidio Grip", "hero_status": "", "launch_date": "2020-05-08", "dummy_item_creation_date": "", "npi_announcement_date": "", "pre_order_date": "", "ga_date": "", "landed_at_launch_date": "", "planned_end_of_purchase": "", "planned_end_of_replen": "", "planned_end_of_forecast": "", "independence_date": "", "disable_date": "2021-04-29", "accessory_retail_end_of_life": "" }, { "npi_code": "NEW", "cifa_category": "XM", "o9_category": "Accessories", "equipment_type": "AC", "equipment_sub_type": "CASEPROT", "model_manf": "137181-1050", "model_comcast": "Samsung Galaxy A51 Presidio Grip", "memory": "", "color": "Black", "os": "", "upc": 849000000000, "sku": 849000000000, "cifa_id": 273271, "manufacturer_part": "137181-1050", "description": "Speck Samsung Galaxy A51 Presidio Grip - Black", "uom": "", "manufacturer": "SPK", "serialized": "N", "equip_id_type": "ICCID", "pre_inserted_sim": "", "sim_type": "", "sim_form": "", "base_feature_tier": "", "market_attractiveness": "", "memory_tier": "", "size_tier": "", "planning_item": 848709087461, "stat_item": "Samsung Galaxy A51 Presidio Grip", "model_mem": "Samsung Galaxy A51 Presidio Grip", "model_mem_color": "Samsung Galaxy A51 Presidio Grip", "hero_status": "", "launch_date": "2020-05-08", "dummy_item_creation_date": "", "npi_announcement_date": "", "pre_order_date": "", "ga_date": "", "landed_at_launch_date": "", "planned_end_of_purchase": "", "planned_end_of_replen": "", "planned_end_of_forecast": "", "independence_date": "", "disable_date": "2021-04-29", "accessory_retail_end_of_life": "" } ] ... View more

Thanks @SAMSAL, I was tracking that previous post but since it was so old I was hoping newer versions of NiFi could address this.  This is such a simple thing with XML and the EvaluateXPath processor, I am just surprised that we can't do something similar with JSON.  Oh well, 2 processors it is. ... View more

Hi, Try the following Jolt spec:   [ { "operation": "shift", "spec": { "tags": { "*": { "tag": "tags.[#2].Parameter", "value": "tags.[#2].value" } } } } ] If you find this helpful please accept solution. ... View more

There should be two controllers configured:   DistributedMapCacheClientService DistributedMapCacheServer Client is, eh, client, server is a backend for your cache. Without server client has nowhere to send a flowfile. ... View more

Thank you all. I eventually evaluated the json path to extract the url. My mind was astray as i was using complex solution to a simple problem.  ... View more