Reply
New Contributor
Posts: 4
Registered: ‎06-17-2014

How to update Catalog's metadata after creating tables in Hive?

[ Edited ]

Hello,

 

It seems taht Catalog-service enabled Imalad instances to synchronize their metadata. However, I find that If I create a table in Hive, Impala is not able to see it right away , I'm wondering if there is any approach to force Catalog-service to synchronize metadata(stored in MySQL) with Hive ? (better through JDBC) Thanks!

 

I'm using Impala 1.2+, refresh

Highlighted
New Contributor
Posts: 4
Registered: ‎06-17-2014

Re: How to update Catalog's metadata after creating tables in Hive?

Seems INVALIDATE METADATA and REFRESH commands could do the trick, I'll try them first, Thanks!

Cloudera Employee
Posts: 27
Registered: ‎09-27-2013

Re: How to update Catalog's metadata after creating tables in Hive?

Impala caches hive metastore metadata and will not automatically pick up tables created in Hive. We're looking into ways to

make that better but for now the solution is what you've already found. Here's a link to some more docs on how those commands

work:

 

http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Installing-and-Using-Im...

Announcements

Our community is getting a little larger. And a lot better.


Learn More about the Cloudera and Hortonworks community merger planned for late July and early August.