JSONTreeReader behaving different between V1.21 and V1.18

Question

When parsing a json array with a json tree reader (in this case using convert record), I am presented with this error, this testing was done in Nifi Version 1.21.0. However this error never occurs in Version 1.18.0.

An example of json that fails in 1.21.0 that works in 1.18.0

[
    {"a": [ {"b": [{}]}]},
    {"a": [ {"b": []}]}
]

Any help would be greatly appreciated.

cjervis · Answer

Welcome to the community @ollyhank . I'm not an expert but I did find notes that version 1.2 included:

New or Improved Processors, Controller Services, and Reporting Tasks

New Record oriented abstraction for reading/writing schema aware event streams from CSV, JSON, AVRO, Grok, and plaintext with easy extension for other formats/schemas
- QueryRecord processor to execute SQL queries over a stream of records powered by Apache Calcite
- ConvertRecord processor to efficiently transform records from a given schema and format into another schema and format
- SplitRecord processor to efficiently split huge record bundles into configurable batch sizes for divide and conquer or protect downstream systems
- Processors to efficiently stream Records into and out of Apache Kafka in a format and schema aware manner and which automatically handle achieving high throughput and full provenance
- Controller Services for plugging into and managing data schemas (Avro Schema Registry, Hortonworks Schema Registry) that integrate nicely into the record readers and writers

Not sure if it is the issue here, but is something to consider while awaiting someone with more experience to reply.

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.