Reply
Explorer
Posts: 30
Registered: ‎02-01-2017

Schema created in hive how to access in impala without doing a full invalidate metadata

To get a hive table to appear in impala I can do invalidate metadata on everything.

 

But that will be very memory intensive is there a way to invalidate metadata and just get this database invalidated.

 

Like say I have 100 schemas and I create a new one in hive say Ab.

 

Can I do something like invalidate metadata Ab.

 

I know this can be done on a table but what about a schema?

 

Thanks 

Highlighted
Champion
Posts: 545
Registered: ‎05-16-2016

Re: Schema created in hive how to access in impala without doing a full invalidate metadata

[ Edited ]

if you just fire the below command without table name .

INVALIDATE METADATA ;

All the table will be reloaded on the next access. 

I dont have my vm to try  ,let me know if that helps you . 

 

possible recommendation for your consideration. 

 

1. if you can create the same table in impala and avoid this costly process especially if you have 1000s of partition on your table.

 

2. if you just add a data file on the existing table then it is best to go with REFRESH statement over the above . 

Cloudera Employee
Posts: 25
Registered: ‎12-11-2015

Re: Schema created in hive how to access in impala without doing a full invalidate metadata

The feature that you requested is currently not available. But Here is the jira where it is being tracked https://issues.apache.org/jira/browse/IMPALA-1763

Announcements