Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

How to avro encode a kafka message key

New Contributor

I'm trying to produce messages to a kafka topic using the PublishKafkaRecord_0_11 processor. We are also using a confluent schema registry with a schema for both the value and the key. The configurations are attached.

The issue is that our scala consumer isn't able to deserialize the messages due to the message keys not being properly avro encoded with the schema registry. The message values appear to be serialized properly.

Is there an easy way to use the schema registry to encode the message keys as an avro record?

76645-avrorecordsetwriter-config.png

76644-jsontreereader-config.png

76643-producer-config.png

1 REPLY 1

Hi @John King!
I'm not a confluent platform specialist, but how did you set the schema registry?
Was using this config?
https://github.com/confluentinc/schema-registry/blob/master/config/connect-avro-standalone.propertie...
or
https://github.com/confluentinc/schema-registry/blob/master/config/connect-avro-distributed.properti...


Once I had a problem by setting the wrong internal serializers + schema disabled in my schema registry.

Hope this helps! 🙂

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.