Member since
01-19-2020
5
Posts
0
Kudos Received
0
Solutions
07-31-2020
02:25 PM
I am getting similar error. Where are we supposed to add the jar files from the github link provided above. I am able to upload the template, but when I put that in canvas I get this error org.apache.nifi.processors.kite.ConvertJSONToAvro is not known to this NiFi instance
... View more
06-14-2020
07:23 AM
@kirilldemidov Your spec works only if your input is a json object and not json array. For your spec to work on all the records, you have to perform the same operation(your spec) on each record. This can be done as follows: [ { "operation": "shift", "spec": { "*":{ "id": "[&1].id", "event_id": "[&1].event_id", "formula_id": "[&1].formula_id", "ts_start": "[&1].ts_start", "ts_end": "[&1].ts_end", "type": "[&1].type", "details": { "*": { "$": "[&3].equipment_id", "*": { "$": "[&4].parameter", "@": "[&4].value" } } }, "ack_ts": "[&1].ack_ts", "ack_user": "[&1].ack_user" } } } ] Here, "&1" means go one level up in the spec. In [&1].id &1 points to *. '*' is the iteration step value, meaning, index of the input array. For the first record, it will be [1].id,[1].event_id,..... Similarly, &3 (or) &4 means go 3 (or) 4 levels up, so that it points to the same *. Also, try another spec: [
{
"operation": "shift",
"spec": {
"*": {
"details": {
"*": {
"$": "[&3].equipment_id",
"*": {
"$": "[&4].parameter",
"@": "[&4].value"
}
}
},
"*": "[&1].&0"
}
}
}
] The * after "details" ends refers to all the keys in the input json other than "details" key. For further clarifications, refer to https://community.cloudera.com/t5/Community-Articles/Jolt-quick-reference-for-Nifi-Jolt-Processors/tac-p/244351#M407
... View more
01-23-2020
03:34 AM
@kirkade Unfortunately I have MySQL databases but if you could conserve that instalment I could try to reproduce your problem this weekend. I have been overloaded these past days ....To my experience reinstallation might not resolve the problem its usually a good learning curve to face a problem head one just imagine ypu were at a client site you wouldn't ask them to reinstall the environment. Just share the create and postgres load scripts and version so I can reproduce your problem.
... View more