Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Restrict hive tables from Impala

Restrict hive tables from Impala

Explorer

Hello,

 

By anychance will there be a possibility in future to restrict hive tables from impala. I am looking for an option to restrict impala tables/partitions to reduce the load in impala-catalog but still allow them queryable from hive.

 

 

Thanks and Regards

Thybu

1 REPLY 1
Highlighted

Re: Restrict hive tables from Impala

Master Collaborator

Hi!

 

there has not been significant interest in such a feature, so we have not considered it.

 

It might be worth invstigating the current options to see if they can help:

 

1. We recommend running the catalogd with the default configuration of --load_catalog_in_background=false. That way the table metadata is only loaded in the catalogd when an Impala query requests it. So, as long as you only access certain tables from Hive and not Impala, the metadata for those tabes will not burden the catalogd.

2. If memory on the catalogd is a problem, you should be able to wipe the cached metadata with "invalidate metadata <table>".

 

Alex