- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
HBase and Avro
- Labels:
-
Apache HBase
Created on ‎09-20-2017 03:06 PM - edited ‎09-16-2022 05:16 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Does HBase utilize a schema registry like that of Kafka (Confluent)? Otherwise, when using Avro in HBase are you storing the schema in every cell/row to describe the Avro object withion it?
Created on ‎09-21-2017 03:14 AM - edited ‎09-21-2017 03:15 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi stumilius,
We have a blogpost about storing Avro data inside HBase tables. In short, HBase does not know about the avro content, treats it as binary blob. The client which is reading/writing the data has to deal with the avro schemas, after HBase delivered the raw data to it.
Zsolt
Created ‎09-21-2017 07:41 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I understand the issue you mentioned about HBase not knowing or caring about the Avro content. What I'm trying to learn is how to create Avro objects without having to use the Avro write/read functions. Basically I want to:
* Load content into variables (var1 = schema + data)
* HBase put table, var1, var2, etc.
Thanks again
