Short Description: Using JOLT transformation to modify a JSON object. Article: In NIFI, JOLT Transformation can be used to help modifying a JSON object, the below code snippets are an example of how JOLT can be used to shift elements inside a JSON Object, in this case, the intention is to move and repeat "productionID" and "processID" inside of the array. Original JSON Object: { "productionID": "BHS0928MDB8391", "productionLine": [ { "model": "Cooper", "year": 2018, "type": "Hatchback", "motorization": "Electric", "colour": "Midnight Black", "stageID": "MGOP94810482042" }, { "model": "Cooper", "year": 2018, "type": "Hatchback", "motorization": "Diesel", "colour": "Silver", "stageID": "MGOP9183740194" } ], "processID": "884910421743POR4183UK" } Target JSON Object: { "productionLine" : [ { "model" : "Cooper", "year" : 2018, "type" : "Hatchback", "motorization" : "Electric", "colour" : "Midnight Black", "stageID" : "MGOP94810482042", "productionID" : "BHS0928MDB8391", "processID" : "884910421743POR4183UK" }, { "model" : "Cooper", "year" : 2018, "type" : "Hatchback", "motorization" : "Diesel", "colour" : "Silver", "stageID" : "MGOP9183740194", "productionID" : "BHS0928MDB8391", "processID" : "884910421743POR4183UK" } ] } JOLT transformation code used: [ { "operation": "shift", "spec": { "productionLine": { "*": { "@": "[&1]", "@(2,productionID)": "[&1].productionID", "@(2,processID)": "[&1].processID" } } } }, { "operation": "shift", "spec": { "*": { "@": "productionLine" } } } ] ... View more

Short Description Storm Service Check fails with a Kerberos error after performing an Ambari upgrade in a cluster that had Metron installed. Article In a cluster where Metron was removed before upgrading Ambari server, the following error can occur when performing a Service Check in Storm service: Exception in thread "main" java.lang.RuntimeException: java.lang.RuntimeException: The TGT found is not renewable at org.apache.storm.security.auth.kerberos.AutoTGT.populateCredentials(AutoTGT.java:1) at org.apache.storm.StormSubmitter.populateCredentials(StormSubmitter.java:3) at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:748) at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:590) at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:239) at storm.starter.WordCountTopology.main(WordCountTopology.java:492) Caused by: java.lang.RuntimeException: The TGT found is not renewable at org.apache.storm.security.auth.kerberos.AutoTGT.populateCredentials(AutoTGT.java:291) Solution Go to Ambari -> Storm Service -> Configs -> Custom storm-site and remove the following properties: topology.auto-credentials=['org.apache.storm.security.auth.kerberos. AutoTGT'] nimbus.credential.renewers.classes=['org.apache.storm.security.auth.kerberos.AutoTGT'] supervisor.run.worker.as.user=true ... View more