question Re: Kafka schema registry service in CDH 5.7 / 5.8 in Support Questions

Kafka schema registry service in CDH 5.7 / 5.8

zhuw.bigdata — Fri, 16 Sep 2022 10:46:00 GMT

I am trying to do data ingestion btw HDFS and Kafka. There are a few options: Conflunent Connect and Linkedin Gobblin. However, both requires Kafka schema registry. I can't find it in CDH distro. Could someone shed some light on this?

Re: Kafka schema registry service in CDH 5.7 / 5.8

Gordo — Mon, 31 Oct 2016 11:37:20 GMT

We currently use the Confluent Schema Registry. It doesn't come as part of CDH, but as it is open source, we simply install it on our Cloudera Kafka nodes and it works just fine.

StreamSets also works well with the schema registry now that the latest version (2.1) supports it when working with Avro.

Re: Kafka schema registry service in CDH 5.7 / 5.8

zhuw.bigdata — Sat, 12 Nov 2016 03:15:33 GMT

That is exactly I put in a hybrid solution. Just need to match CDH Kafka version with Confluence version.

Re: Kafka schema registry service in CDH 5.7 / 5.8

jsudrik — Thu, 06 Apr 2017 12:27:03 GMT

Hi,

What about version of Schema Registry? Which version should be used with CDH 5.8?

Thanks in advance..