question Avro Schema Registry in Archives of Support Questions (Read Only)

Avro Schema Registry

markdoutre — Fri, 16 Sep 2022 10:29:28 GMT

Currently looking at implementing an Avro Schema Registry that we can integate with Kafka. Any recommendations / implementations anyone can point to?

Re: Avro Schema Registry

sunile_manjee — Tue, 12 Jul 2016 00:56:00 GMT

@mark doutre difficult to provide recommendations without knowing the use case. One thing that stands out to me with ASR is the source data generating app will have to adhere to a schema. This ends up provide just another maintance issue on the app side. For me I rather have the data flow into NiFi and have it forks based on the type of data feed in.

Re: Avro Schema Registry

vvaks — Thu, 01 Sep 2016 05:05:52 GMT

@mark doutre

Check out this article

https://community.hortonworks.com/content/kbentry/51379/avro-schema-registry-with-apache-atlas-for-streami.html

and this tutorial

https://community.hortonworks.com/articles/51432/apache-atlas-as-an-avro-schema-registry-test-drive.html

Hortonworks is looking into providing an official Avro Schema Registry with Integration to Atlas but this is an example of how you can implement it yourself and the benefits it would bring.

Re: Avro Schema Registry

mark_davis2 — Wed, 07 Sep 2016 00:12:24 GMT

To answer the original question, Confluent avro schema registry is probably the gold-standard here I think if it's kafka you are dealing with. There is a docker version if you want to try it quickly. It's not perfect but it's well ahead of the atlas approach for now I think since it does schema validation, compatibility checks, etc. If there is another approach coming out (e.g. atlas-backed soln) it might be nice if the apis were compatible,.. just sayin!

Re: Avro Schema Registry

matias_basilico — Tue, 28 Feb 2017 22:22:42 GMT

Is there any docker image with Hortonworks AVRO schema registry or a step by step guide for deploy It in OpenShift??

Thanks in advance!

Re: Avro Schema Registry

anandt8dev — Fri, 01 Dec 2017 19:39:26 GMT

Docker image of hortonworks schema registry:

https://hub.docker.com/r/thebookpeople/hortonworks-registry/