Member since
11-02-2020
3
Posts
0
Kudos Received
0
Solutions
01-12-2021
09:49 AM
I am running into an error identical to this one on NiFi 1.11.4. Is it possible that some form of this bug has persisted, or is the cause likely to be different?
... View more
12-28-2020
10:56 AM
Hi Ana, Unfortunately I didn't find a "clean" solution for this at all- ended up converting my Avro records to JSON (using ConvertAvroToJSON), then ran into some similar issues with the ConvertJSONToSQL processor (it wasn't able to correctly generate SQL for all relevant data types- I seem to recall datetimes being an issue?), so used a Python ExecuteScript processor to convert JSON to SQL statements before executing these with PutSQL. TL;DR: Avro records -> ConvertAvroToJSON -> ExecuteScript ("homemade" JSON to SQL conversion) -> PutSQL Hope this helps!
... View more
11-02-2020
04:00 PM
@stevenmatison Think I've managed to hit this as well. Some relevant screenshots (processor config, schema): https://imgur.com/a/Z4EH5wG Schema for good measure: {
"type": "record",
"namespace": "com.asdf",
"name": "sdfg",
"fields": [
{ "name": "doc_id", "type": {"type": "array", "items": "long"} },
{ "name": "start_id", "type": {"type": "array", "items": "int"} },
{ "name": "end_id", "type": {"type": "array", "items": "int"} },
{ "name": "passage_date", "type": {"type": "int", "logicalType": "date"} },
{ "name": "passage_time", "type": {"type": "int", "logicalType": "time-millis"} }
]
} Thanks- any insight would be much appreciated!
... View more