question NIFI: Unable to post AVRO message to kafka topic using Confluence Schema Registry service in Support Questions

NIFI: Unable to post AVRO message to kafka topic using Confluence Schema Registry service

MariaE — Fri, 04 Apr 2025 00:58:40 GMT

Hi community,

Our NIFI version: 1.23.0.
We are converting JSON message to AVRO format and posting to KAFKA topic using

PublishKafkaRecord_2_0 1.23.0:

JSON Tree Reader:

AVRO Record Set Writer:

Confluent Schema Registry:

We are not able to post the message with the error below.
We are able to see the AVRO schema in the KAFKA registry through POSTMAN and using browser URL and we are able to connect to that KAFKA topic with the same parameters in NIFI .

Could you please help us to resolve this issue.

Error:

Re: NIFI: Unable to post AVRO message to kafka topic using Confluence Schema Registry service

MattWho — Fri, 04 Apr 2025 17:18:40 GMT

@MariaE

It sounds like from the shared exception the data coming from your source json did not match the schema returned from "zv60-u-ab-...". Looks like the data had a null value in the channel field but the schema does not support null values.

So either an issue with the source data or the schema needs to be modified to support null values.

Please help our community grow. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped.

Thank you,
Matt

Re: NIFI: Unable to post AVRO message to kafka topic using Confluence Schema Registry service

MariaE — Fri, 04 Apr 2025 19:51:12 GMT

Hi Matt,
yes it was the case of null values - we updated avro schema and set default values for enums and were able to connect and post messages to kafka.
Thanks