Kafka schema registry service in CDH 5.7 / 5.8

[#1]

I am trying to do data ingestion btw HDFS and Kafka. There are a few options: Conflunent Connect and Linkedin Gobblin. However, both requires Kafka schema registry. I can't find it in CDH distro. Could someone shed some light on this?

[#2 · Accepted solution]

We currently use the Confluent Schema Registry. It doesn't come as part of CDH, but as it is open source, we simply install it on our Cloudera Kafka nodes and it works just fine.

StreamSets also works well with the schema registry now that the latest version (2.1) supports it when working with Avro.

[#3]

That is exactly I put in a hybrid solution. Just need to match CDH Kafka version with Confluence version.

[#4]

Hi,

What about version of Schema Registry? Which version should be used with CDH 5.8?

Thanks in advance..