Avro Schema Registry

[#1]

Currently looking at implementing an Avro Schema Registry that we can integate with Kafka. Any recommendations / implementations anyone can point to?

[#2]

@mark doutre difficult to provide recommendations without knowing the use case. One thing that stands out to me with ASR is the source data generating app will have to adhere to a schema. This ends up provide just another maintance issue on the app side. For me I rather have the data flow into NiFi and have it forks based on the type of data feed in.

[#3 · Accepted solution]

@mark doutre

Check out this article

https://community.hortonworks.com/content/kbentry/51379/avro-schema-registry-with-apache-atlas-for-s...

and this tutorial

https://community.hortonworks.com/articles/51432/apache-atlas-as-an-avro-schema-registry-test-drive....

Hortonworks is looking into providing an official Avro Schema Registry with Integration to Atlas but this is an example of how you can implement it yourself and the benefits it would bring.

[#4]

To answer the original question, Confluent avro schema registry is probably the gold-standard here I think if it's kafka you are dealing with. There is a docker version if you want to try it quickly. It's not perfect but it's well ahead of the atlas approach for now I think since it does schema validation, compatibility checks, etc. If there is another approach coming out (e.g. atlas-backed soln) it might be nice if the apis were compatible,.. just sayin!

[#5]

Is there any docker image with Hortonworks AVRO schema registry or a step by step guide for deploy It in OpenShift??

Thanks in advance!

[#6]

Docker image of hortonworks schema registry:

https://hub.docker.com/r/thebookpeople/hortonworks-registry/