- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
NIFI: Unable to post AVRO message to kafka topic using Confluence Schema Registry service
- Labels:
-
Apache NiFi
Created ‎04-03-2025 05:58 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi community,
Our NIFI version: 1.23.0.
We are converting JSON message to AVRO format and posting to KAFKA topic using
JSON Tree Reader:
AVRO Record Set Writer:
Confluent Schema Registry:
We are not able to post the message with the error below.
We are able to see the AVRO schema in the KAFKA registry through POSTMAN and using browser URL and we are able to connect to that KAFKA topic with the same parameters in NIFI .
Could you please help us to resolve this issue.
Error:
Created ‎04-04-2025 10:18 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@MariaE
It sounds like from the shared exception the data coming from your source json did not match the schema returned from "zv60-u-ab-...". Looks like the data had a null value in the channel field but the schema does not support null values.
So either an issue with the source data or the schema needs to be modified to support null values.
Please help our community grow. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped.
Thank you,
Matt
Created ‎04-04-2025 10:18 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@MariaE
It sounds like from the shared exception the data coming from your source json did not match the schema returned from "zv60-u-ab-...". Looks like the data had a null value in the channel field but the schema does not support null values.
So either an issue with the source data or the schema needs to be modified to support null values.
Please help our community grow. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped.
Thank you,
Matt
Created ‎04-04-2025 12:51 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Matt,
yes it was the case of null values - we updated avro schema and set default values for enums and were able to connect and post messages to kafka.
Thanks
