I am trying to transform a json using jolt where i am moving the array inside serviceCharacteristic to outside of service {}, eventually i plan to move to respective positions    { "serviceOrderItem": [ { "action": "modify", "id": "0965f63b-db26-4397-b222-190a891838f0", "service": { "href": "serviceInventory/v4/service/adaptiveNetworkSite/1b9a3fae-f50b-4310-887d-60988f8d5645", "id": "adaptiveNetworkSite", "serviceCharacteristic": [ { "name": "modifyPath", "value": [ { "op": "add", "path": "$.supportingService", "value": {} }, { "op": "sub", "path": "$.supportingService", "value": {} } ] } ] } }, { "action": "create", "id": "0965f63b-db26-4397-b222-190a891838f0", "service": { "href": "serviceInventory/v4/service/adaptiveNetworkSite/1b9a3fae-f50b-4310-887d-60988f8d5645", "id": "adaptiveNetworkSite", "serviceCharacteristic": [ { "name": "modifyPath", "value": [ { "op": "abcd", "path": "$.supportingService", "value": { "state": "active" } }, { "op": "efgh", "path": "$.supportingService", "value": { "state": "active" } } ] } ] } } ] }   desired output is    { "serviceOrderItem": [ { "action": "modify", "id": "0965f63b-db26-4397-b222-190a891838f0", "service": { "href": "serviceInventory/v4/service/adaptiveNetworkSite/1b9a3fae-f50b-4310-887d-60988f8d5645", "id": "adaptiveNetworkSite" } "modifyPath": [ { "op": "add", "path": "$.supportingService", "value": {} }, { "op": "sub", "path": "$.supportingService", "value": {} } ] }, { "action": "create", "id": "0965f63b-db26-4397-b222-190a891838f0", "service": { "href": "serviceInventory/v4/service/adaptiveNetworkSite/1b9a3fae-f50b-4310-887d-60988f8d5645", "id": "adaptiveNetworkSite" } "modifyPath": [ { "op": "abcd", "path": "$.supportingService", "value": { "state": "active" } }, { "op": "efgh", "path": "$.supportingService", "value": { "state": "active" } } ] } } ] }   my Jolt is working only when there is single array in modifyPath     [{ "operation": "shift", "spec": { "*": "&", "serviceOrderItem": { "*": { "*": "serviceOrderItem[&1].&", "service": { "*": "serviceOrderItem[&2].service.&", "serviceCharacteristic": { "*": { "value": "@(1,name)" } } } } } } }, { "operation": "shift", "spec": { "*": "&", "modifyPath": { "@(1,modifyPath)": "serviceOrderItem[0].modifyPath" }, "supportingService": { "@(1,supportingService)": "serviceOrderItem[0].service.supportingService" } } }]     when multiple array is given it shuffles the array,   "serviceOrderItem" : [ { "action" : "modify", "id" : "0965f63b-db26-4397-b222-190a891838f0", "modifyPath" : [ { "op" : "add", "path" : "$.supportingService", "value" : { } }, { "op" : "sub", "path" : "$.supportingService", "value" : { } }, [ { "op" : "abcd", "path" : "$.supportingService", "value" : { "state" : "active" } }, { "op" : "efgh", "path" : "$.supportingService", "value" : { "state" : "active" } } ] ], "service" : { "href" : "serviceInventory/v4/service/adaptiveNetworkSite/1b9a3fae-f50b-4310-887d-60988f8d5645", "id" : "adaptiveNetworkSite" } }, { "action" : "create", "id" : "0965f63b-db26-4397-b222-190a891838f0", "service" : { "href" : "serviceInventory/v4/service/adaptiveNetworkSite/1b9a3fae-f50b-4310-887d-60988f8d5645", "id" : "adaptiveNetworkSite" } } ] }         please advise , thank you for you time       ... View more

I am new to Jolt, I am trying to transform JSON to a particular format using nifi, where i am moving some objects into another object, I think i am close This is my JSON { "relatedParty": [ { "id": "B2BSmallandMedium" } ], "serviceOrderItem": [ { "id": "e26205f4-e144-4ded-9e64-82ede0b26f4", "action": "add", "service": { "name": "cust", "state": "active", "supportingService": [ { "id": "e26205f4-e144-4ded-9e64-82ede0b26e99", "href": "serviceInventory/v4/service" }, { "id": "7313c885-a075-4188-a6bc-c3fbfb4c7422", "href": "activationAndConfiguration/v4/service" } ] } } ] } I am new to Jolt, I am trying to transform JSON to a particular format, where i am moving some objects into another object, I think i am close. This is my JSON { "relatedParty": [ { "id": "B2BSmallandMedium" } ], "serviceOrderItem": [ { "id": "e26205f4-e144-4ded-9e64-82ede0b26f4", "action": "add", "service": { "name": "cust", "state": "active", "supportingService": [ { "id": "e26205f4-e144-4ded-9e64-82ede0b26e99", "href": "serviceInventory/v4/service" }, { "id": "7313c885-a075-4188-a6bc-c3fbfb4c7422", "href": "activationAndConfiguration/v4/service" } ] } } ] } I am using the JOLT     [ { "operation": "shift", "spec": { "relatedParty": "relatedParty", "serviceOrderItem": { "*": { "id": "serviceOrderItem[&1].id", "action": "serviceOrderItem[&1].action", "service": { "*": "serviceOrderItem[&2].service.&", "#modifyPath": "serviceOrderItem[&2].service.serviceCharacteristic[0].name", "@(1,modifyPath)": "serviceOrderItem[&2].service.serviceCharacteristic[0].value", "#supportingService": "serviceOrderItem[&2].service.serviceCharacteristic[1].name", "@(1,service.supportingService)": "serviceOrderItem[&2].service.serviceCharacteristic[1].value" } } } } }, { "operation": "modify-default-beta", "spec": { "serviceOrderItem": { "*": { "service": { "serviceCharacteristic": { "*": { "value": [] } } } } } } }, { "operation": "remove", "spec": { "serviceOrderItem": { "*": { "service": { "supportingService": "" } } } } }]     this is now giving me "service" : { "name" : "cust", "serviceCharacteristic" : [ { "name" : "modifyPath", "value" : "[]" }, { "name" : "supportingService", "value" : [ { "href" : "serviceInventory/v4/service", "id" : "e26205f4-e144-4ded-9e64-82ede0b26e99" }, { "href" : "activationAndConfiguration/v4/service", "id" : "7313c885-a075-4188-a6bc-c3fbfb4c7422" } ] } ], "state" : "active" } } ] This is working for me but, I would like to know if it is possible replace: "#modifyPath": "serviceOrderItem[&2].service.serviceCharacteristic[0].name" "#supportingService": "serviceOrderItem[&2].service.serviceCharacteristic[1].name" to update the Json only when the key is actually available. I do not want an empty array. Thank you for your time   ... View more

I have a flowfile that is a list of files, that gets split into individual flowfiles (10 in this case) I am using FetchSFTP to fetch the file from a sftp location, the content of this fetched file is then split and is processed and stored. In this example: I want to start processing ep.txt only after i have processed bulk.txt after that names.txt and so on. I was referring to these links: NiFi workflow monitoring – Wait/Notify pattern with split and merge – Pierre Villard and  How to wait for all fragments to be processed, then do something? (ijokarumawak.github.io) I was able to implement something like this.   but this is not what I was looking for, I want to implement a wait before fetchSFTP  I tried release signal identifier with filename , but that was stopping any flowfile from moving forward.   Please advise, thank you  ... View more