I have flattened a json using jolt since the input was json array it has resulted in list for the keys. But to use PutHBaseJson processor I need scalar values to define rowkey. Is there a way to repeat the whole json again and keep one value at a time? So that the uniqueness is maintained.
Below are my input, transformation and output Input {
"resource": {
"id": "1234",
"name": "Resourse_Name"
},
"data": [
{
"measurement": {
"key": "5678",
"value": "status"
},
"timestamp": 1517784040000,
"value": 1
},
{
"measurement": {
"key": "91011",
"value": "location"
},
"timestamp": 1519984070000,
"value": 0
}
]
}
Transformation [
{
"operation": "shift",
"spec": {
"resource": {
"id": "resource_id",
"name": "resource_name"
},
//
// Turn all the SecondaryRatings into prefixed data
// like "rating-Design" : 4
"data": {
"*": {
// the "&" in "rating-&" means go up the tree 0 levels,
// grab what is ther and subtitute it in
"measurement": {
"*": "measurement_&"
},
"timestamp": "measurement_timestamp",
"value": "value"
}
}
}
}
]
Output {
"resource_id" : "1234",
"resource_name" : "Resourse_Name",
"measurement_key" : [ "5678", "91011" ],
"measurement_value" : [ "status", "location" ],
"measurement_timestamp" : [ 1517784040000, 1519984070000 ],
"value" : [ 1, 0 ]
}
Expected output {
"resource_id" : "1234",
"resource_name" : "Resourse_Name",
"measurement_key" : "5678",
"measurement_value" : "status",
"measurement_timestamp" : 1517784040000, ,
"value" : 1
},
{
"resource_id" : "1234",
"resource_name" : "Resourse_Name",
"measurement_key" : "91011" ,
"measurement_value" : "location" ,
"measurement_timestamp" : 1519984070000 ,
"value" : 0
}
... View more
