- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
how could i register an avro schema to hive metastore using apache nifi
- Labels:
-
Apache Hive
Created on
‎11-06-2019
04:30 AM
- last edited on
‎11-06-2019
05:39 AM
by
cjervis
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have a dataflow and in this dataflow i generate an avro schema from the processor avroinferschema, and my doubt is how can i resgiter in hive metastore this avro.avsc, i need to integrate a schema evolution between avro and hive, also i found a nifi service : avro schema registry, but I do not know how it is used?
Created ‎08-17-2021 01:54 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have the same question. Does anyone have any good ideas on how to do this ?
Created ‎08-17-2021 01:56 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Or actually how to register an avro schema with HIVE using anything....
Created ‎08-18-2021 05:33 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @Daggers,
I'm not an expert but did a quick search to see what I could find, here is a link that I hope will be useful.
How to automate creation of Avro and Hive Schemas using NiFi and Schema Registry?
Cy Jervis, Manager, Community Program
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Created on ‎09-18-2021 10:00 PM - edited ‎09-18-2021 10:03 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @Daggers
You can store avro schema file in HDFS folder and point that folder for your hive table ..There is avro.schema.url property with value can be passed while Hive creating the table ..This solution works for versioning the avro schema file in HDFS for the respective table. You can explore schema registry as well
