question Re: pull metadata from Hive metastore in Archives of Support Questions (Read Only)

pull metadata from Hive metastore

yan_chen04 — Wed, 03 Aug 2016 01:39:19 GMT

I would like to pull metadata from Hive metastore without wrong about what database metastore uses. It seems like I have following APIs to use:

1. Hive Server2 JDBC

2. WebHCatalog

3. Hive Metastore Client

(Or there are more options)

I'm building a tool to pull metadata and maybe want to keep my pulled metadata up to date. Which API would work best for me?

Any related information will be highly appreciated.

Re: pull metadata from Hive metastore

cstanca — Thu, 04 Aug 2016 03:23:42 GMT

@Yan Chen\

For example, I would use the API corresponding for the Hive version. Here is an example for 0.13, which I heavily relied on the following to do something somehow similar with what you are trying to do:

https://hive.apache.org/javadocs/r0.13.1/api/metastore/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.html

https://hive.apache.org/javadocs/r0.13.1/api/metastore/org/apache/hadoop/hive/metastore/MetaStoreUtils.html

I used some resources from here: http://www.javased.com/index.php?api=org.apache.hadoop.hive.metastore.api.MetaException

Let me know if this helps or you need more help.

Re: pull metadata from Hive metastore

yan_chen04 — Tue, 16 Aug 2016 00:14:10 GMT

thanks a lot