Hi, It seems like you are generating your SQL from JSONToSQL kind of processor and then using PUT SQL to execute the generated SQL statement from earlier processor , is this correct? If that is the case I dont think there is an easy way to capture the actual values in the SQL statement as they are expected to be part of the generated sql flow file attribute in the format of "sql.args.N.value" based on the PUTSQL documentation. The only suggestion I have to overcome such thing is to write your custom code inside ExecuteScript processpr after the "retries-exceeded"  relationship to replace the place holders (?,?,?..) in the flowfile content with sql.args.N.value attribute where the N = place holder Index + 1, so you have to write some logic to extract the place holder , save into variable , split the variable using (,), loop through the array of "?", construct new variable with sql.args.[i+1]ivalue , when the loop finish replace the place holder string with the new value string , then store new result into new flowfile content and send to success. For more info on writing custom script using ExecuteScript : https://community.cloudera.com/t5/Community-Articles/ExecuteScript-Cookbook-part-1/ta-p/248922 https://community.cloudera.com/t5/Community-Articles/ExecuteScript-Cookbook-part-2/ta-p/249018 If anyone has a better idea please feel free to provide your input. If that helps please accept solution. Thanks       ... View more

Hi , Can you provide the expected json output? The json you provided seems complex and nested. I'm not sure what exactly you are expecting. ... View more

Hi , Can you replace the following:   { "operation": "shift", "spec": { "properties": { "*": { // simple match. Put the value '4' in the output under the "Rating" field "title": "Questions[&1].question", "type": { "number": { "#select": "Questions[&3].type" }, "string": { "#textarea": "Questions[&3].type" }, "array": { "#multiselect": "Questions[&3].type" } }, "$": "Questions[&1].id" } } with the following spec: { "operation": "shift", "spec": { "properties": { "*": { // simple match. Put the value '4' in the output under the "Rating" field "title": "Questions_&1.question", "type": { "number": { "#select": "Questions_&3.type" }, "string": { "#textarea": "Questions_&3.type" }, "array": { "#multiselect": "Questions_&3.type" } }, "$": "Questions_&1.id" } } } } , { "operation": "shift", "spec": { "*": "&", "Questions_*": "Questions[]" } }   Reference : https://stackoverflow.com/questions/70394715/remove-null-from-array-using-jolt   If that helps please accept solution. Thanks     ... View more

Hi, Can you explain on what basis are you trying to extract "options":  9876 & 9875 only  and not 9874? Is it based on the index as in the first option and the second option only and ignore anything after?   ... View more

Im not sure what you specified is makes sense  because you would have two keys with the same name "Details" but different values. I assume what you want is this:     { "Details": { "0": { "test1": "test output", "test2": "test output", "id": "first", "name": "the first one" }, "1": { "test1": "test output", "test2": "test output", "id": "second", "name": "the second one" } } }   In this case the spec would be like this:   [ { //package all test fields into an outer object "operation": "shift", "spec": { "test*": "outer.&", "Details": "Details" } }, { // Insert each outer object into Details element 0,1,.. "operation": "shift", "spec": { "Details": { "*": { "*": "Details.&1.&", "@(3,outer)": "Details.&1.outer" } } } }, { //Bucket each outer object (test1, test2...) into each details element "operation": "shift", "spec": { "Details": { "*": { "*": "Details.&1.&", "outer": { "*": { "@": "Details.&3.&" } } } } } } ]   Not sure if this is the best way, if someone knows a better way please  provide your suggestion. If that answers your question please accept solution. Thanks   ... View more

Hi,   You have not specified the desired output, but would the following give you what you are looking for: [ { "operation": "shift", "spec": { "Details": { "*": { "*": "Details[#2].&" } }, "*": "outer[].&" } }, { "operation": "shift", "spec": { "Details": "Details", "outer": { "*": { "*": "Details[&1].&" } } } } ] if that helps please accept solution. Thanks ... View more