I am running NiFi 1.24 in my local as a docker image in WSL as a standalone mode, trying to implement SiteToSiteProvenanceReportingTask. I was referring to Extracting NiFi Provenance Data using SiteToSitePr... - Cloudera Community - 248469 to set it up. docker has volume mounted the conf directory so that i can change properties. Every time I set the nifi.remote.input.secure to false and rerun the docker, it reset the property file to true. I have tried changing the other properties, they don't reset back to default.I have tried setting the env variable using -e SITE_TO_SITE_SECURE=false and -e NIFI_REMOTE_INPUT_SECURE=false, both have unfortunately not taken effect.docker command     docker run -d --name nifi24 -p 8443:8443 -e SITE_TO_SITE_SECURE=false -v ~/tools/nifi24_conf/conf:/opt/nifi/nifi-current/conf -v ~/tools/nifi24_conf/lib:/opt/nifi/nifi-current/lib -v ~/tools/nifi24_conf/nar_extensions:/opt/nifi/nifi-current/extensions apache/nifi:1.24.0       site to site properties     # Site to Site properties nifi.remote.input.host=c30abd07b4ba nifi.remote.input.secure=true nifi.remote.input.socket.port=10000 nifi.remote.input.http.enabled=false nifi.remote.input.http.transaction.ttl=30 sec nifi.remote.contents.cache.expiration=30 secs nifi.web.http.host= nifi.web.http.port= nifi.web.http.network.interface.default= ############################################# nifi.web.https.host=c30abd07b4ba nifi.web.https.port=8443 nifi.web.https.network.interface.default= nifi.web.https.application.protocols=http/1.1 nifi.web.jetty.working.directory=./work/jetty nifi.web.jetty.threads=200 nifi.web.max.header.size=16 KB nifi.web.proxy.context.path= nifi.web.proxy.host= nifi.web.max.content.size= nifi.web.max.requests.per.second=30000 nifi.web.max.access.token.requests.per.second=25 nifi.web.request.timeout=60 secs nifi.web.request.ip.whitelist= nifi.web.should.send.server.version=true nifi.web.request.log.format=%{client}a - %u %t "%r" %s %O "%{Referer}i" "%{User-Agent}i"           I have tried to configure the Site To Site Provenance Reporting task        Unfortunately, I am not able to get it working as i understand that it is not possible to configure Site to Site with security disabled while also running NiFi with HTTPS. Those settings go together.  Please advise on how to get this working. Many Thanks ... View more

I am trying to transform a json using jolt where i am moving the array inside serviceCharacteristic to outside of service {}, eventually i plan to move to respective positions    { "serviceOrderItem": [ { "action": "modify", "id": "0965f63b-db26-4397-b222-190a891838f0", "service": { "href": "serviceInventory/v4/service/adaptiveNetworkSite/1b9a3fae-f50b-4310-887d-60988f8d5645", "id": "adaptiveNetworkSite", "serviceCharacteristic": [ { "name": "modifyPath", "value": [ { "op": "add", "path": "$.supportingService", "value": {} }, { "op": "sub", "path": "$.supportingService", "value": {} } ] } ] } }, { "action": "create", "id": "0965f63b-db26-4397-b222-190a891838f0", "service": { "href": "serviceInventory/v4/service/adaptiveNetworkSite/1b9a3fae-f50b-4310-887d-60988f8d5645", "id": "adaptiveNetworkSite", "serviceCharacteristic": [ { "name": "modifyPath", "value": [ { "op": "abcd", "path": "$.supportingService", "value": { "state": "active" } }, { "op": "efgh", "path": "$.supportingService", "value": { "state": "active" } } ] } ] } } ] }   desired output is    { "serviceOrderItem": [ { "action": "modify", "id": "0965f63b-db26-4397-b222-190a891838f0", "service": { "href": "serviceInventory/v4/service/adaptiveNetworkSite/1b9a3fae-f50b-4310-887d-60988f8d5645", "id": "adaptiveNetworkSite" } "modifyPath": [ { "op": "add", "path": "$.supportingService", "value": {} }, { "op": "sub", "path": "$.supportingService", "value": {} } ] }, { "action": "create", "id": "0965f63b-db26-4397-b222-190a891838f0", "service": { "href": "serviceInventory/v4/service/adaptiveNetworkSite/1b9a3fae-f50b-4310-887d-60988f8d5645", "id": "adaptiveNetworkSite" } "modifyPath": [ { "op": "abcd", "path": "$.supportingService", "value": { "state": "active" } }, { "op": "efgh", "path": "$.supportingService", "value": { "state": "active" } } ] } } ] }   my Jolt is working only when there is single array in modifyPath     [{ "operation": "shift", "spec": { "*": "&", "serviceOrderItem": { "*": { "*": "serviceOrderItem[&1].&", "service": { "*": "serviceOrderItem[&2].service.&", "serviceCharacteristic": { "*": { "value": "@(1,name)" } } } } } } }, { "operation": "shift", "spec": { "*": "&", "modifyPath": { "@(1,modifyPath)": "serviceOrderItem[0].modifyPath" }, "supportingService": { "@(1,supportingService)": "serviceOrderItem[0].service.supportingService" } } }]     when multiple array is given it shuffles the array,   "serviceOrderItem" : [ { "action" : "modify", "id" : "0965f63b-db26-4397-b222-190a891838f0", "modifyPath" : [ { "op" : "add", "path" : "$.supportingService", "value" : { } }, { "op" : "sub", "path" : "$.supportingService", "value" : { } }, [ { "op" : "abcd", "path" : "$.supportingService", "value" : { "state" : "active" } }, { "op" : "efgh", "path" : "$.supportingService", "value" : { "state" : "active" } } ] ], "service" : { "href" : "serviceInventory/v4/service/adaptiveNetworkSite/1b9a3fae-f50b-4310-887d-60988f8d5645", "id" : "adaptiveNetworkSite" } }, { "action" : "create", "id" : "0965f63b-db26-4397-b222-190a891838f0", "service" : { "href" : "serviceInventory/v4/service/adaptiveNetworkSite/1b9a3fae-f50b-4310-887d-60988f8d5645", "id" : "adaptiveNetworkSite" } } ] }         please advise , thank you for you time       ... View more

I am new to Jolt, I am trying to transform JSON to a particular format using nifi, where i am moving some objects into another object, I think i am close This is my JSON { "relatedParty": [ { "id": "B2BSmallandMedium" } ], "serviceOrderItem": [ { "id": "e26205f4-e144-4ded-9e64-82ede0b26f4", "action": "add", "service": { "name": "cust", "state": "active", "supportingService": [ { "id": "e26205f4-e144-4ded-9e64-82ede0b26e99", "href": "serviceInventory/v4/service" }, { "id": "7313c885-a075-4188-a6bc-c3fbfb4c7422", "href": "activationAndConfiguration/v4/service" } ] } } ] } I am new to Jolt, I am trying to transform JSON to a particular format, where i am moving some objects into another object, I think i am close. This is my JSON { "relatedParty": [ { "id": "B2BSmallandMedium" } ], "serviceOrderItem": [ { "id": "e26205f4-e144-4ded-9e64-82ede0b26f4", "action": "add", "service": { "name": "cust", "state": "active", "supportingService": [ { "id": "e26205f4-e144-4ded-9e64-82ede0b26e99", "href": "serviceInventory/v4/service" }, { "id": "7313c885-a075-4188-a6bc-c3fbfb4c7422", "href": "activationAndConfiguration/v4/service" } ] } } ] } I am using the JOLT     [ { "operation": "shift", "spec": { "relatedParty": "relatedParty", "serviceOrderItem": { "*": { "id": "serviceOrderItem[&1].id", "action": "serviceOrderItem[&1].action", "service": { "*": "serviceOrderItem[&2].service.&", "#modifyPath": "serviceOrderItem[&2].service.serviceCharacteristic[0].name", "@(1,modifyPath)": "serviceOrderItem[&2].service.serviceCharacteristic[0].value", "#supportingService": "serviceOrderItem[&2].service.serviceCharacteristic[1].name", "@(1,service.supportingService)": "serviceOrderItem[&2].service.serviceCharacteristic[1].value" } } } } }, { "operation": "modify-default-beta", "spec": { "serviceOrderItem": { "*": { "service": { "serviceCharacteristic": { "*": { "value": [] } } } } } } }, { "operation": "remove", "spec": { "serviceOrderItem": { "*": { "service": { "supportingService": "" } } } } }]     this is now giving me "service" : { "name" : "cust", "serviceCharacteristic" : [ { "name" : "modifyPath", "value" : "[]" }, { "name" : "supportingService", "value" : [ { "href" : "serviceInventory/v4/service", "id" : "e26205f4-e144-4ded-9e64-82ede0b26e99" }, { "href" : "activationAndConfiguration/v4/service", "id" : "7313c885-a075-4188-a6bc-c3fbfb4c7422" } ] } ], "state" : "active" } } ] This is working for me but, I would like to know if it is possible replace: "#modifyPath": "serviceOrderItem[&2].service.serviceCharacteristic[0].name" "#supportingService": "serviceOrderItem[&2].service.serviceCharacteristic[1].name" to update the Json only when the key is actually available. I do not want an empty array. Thank you for your time   ... View more