Support Questions
Find answers, ask questions, and share your expertise

Avro Schema Registry

Contributor

Currently looking at implementing an Avro Schema Registry that we can integate with Kafka. Any recommendations / implementations anyone can point to?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Avro Schema Registry

Guru

@mark doutre

Check out this article

https://community.hortonworks.com/content/kbentry/51379/avro-schema-registry-with-apache-atlas-for-s...

and this tutorial

https://community.hortonworks.com/articles/51432/apache-atlas-as-an-avro-schema-registry-test-drive....

Hortonworks is looking into providing an official Avro Schema Registry with Integration to Atlas but this is an example of how you can implement it yourself and the benefits it would bring.

View solution in original post

5 REPLIES 5

Re: Avro Schema Registry

Super Guru

@mark doutre difficult to provide recommendations without knowing the use case. One thing that stands out to me with ASR is the source data generating app will have to adhere to a schema. This ends up provide just another maintance issue on the app side. For me I rather have the data flow into NiFi and have it forks based on the type of data feed in.

Re: Avro Schema Registry

Guru

@mark doutre

Check out this article

https://community.hortonworks.com/content/kbentry/51379/avro-schema-registry-with-apache-atlas-for-s...

and this tutorial

https://community.hortonworks.com/articles/51432/apache-atlas-as-an-avro-schema-registry-test-drive....

Hortonworks is looking into providing an official Avro Schema Registry with Integration to Atlas but this is an example of how you can implement it yourself and the benefits it would bring.

View solution in original post

Re: Avro Schema Registry

Explorer

To answer the original question, Confluent avro schema registry is probably the gold-standard here I think if it's kafka you are dealing with. There is a docker version if you want to try it quickly. It's not perfect but it's well ahead of the atlas approach for now I think since it does schema validation, compatibility checks, etc. If there is another approach coming out (e.g. atlas-backed soln) it might be nice if the apis were compatible,.. just sayin!

Re: Avro Schema Registry

New Contributor

Is there any docker image with Hortonworks AVRO schema registry or a step by step guide for deploy It in OpenShift??

Thanks in advance!

Re: Avro Schema Registry

New Contributor

Docker image of hortonworks schema registry:

https://hub.docker.com/r/thebookpeople/hortonworks-registry/