flatten json using nifi

[#1]

Hello All,

I want to flatten json records using nifi. The records are store in kafka as AVRO. I use the ConsumeKafkaRecord processor to convert avro to json. For flattening I would like to use the JoltTransformJSON processor, but this doesn't work since it expect as input a single json and not an array of json records.

Any ideas, how I can do this ?

Ideally is that I don't have to convert the records to json, but it seems that currently there is no processor to flatten avro.

Regards,

Chris

[#2]

@chris herssens

After convert Avro to json processor use SplitJson processor with below configurations in it, if your data is having json Array then SplitJson processor split the array and every flowfile would be single record.

then use JoltTransform processor to flatten the json record.

Flow:-

ConsumeKafka--> convertAvroToJSON-->SplitJSON-->JoltTransform

[#3]

I have done this, but this gives performance issues.

I found how to do this with the JoltTransform processor.

[#4]

could you please share the nifi template for this. I am not able to achieve this.