Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Automate Impala views on Hive external table

Automate Impala views on Hive external table

I have external tables in Hive with location set on recursive directories in HDFS. Since Impala doesn't not read data in such external hive tables. So I was looking for a way to create Impala Views on top of Hive tables. How can I automate Impala views so that they will reflect changes as soon as there is a change in Hive tables.

My Use case is: Whenever there is new Hive table in Metastore, Create Impala View on it. If Hive table is dropped, View Should be dropped too. Any changes in Hive table structure, should Update the existing Impala View.  Basically keeping sync between Hive tables and Impala Views. 

How can I trigger this automatic process.

3 REPLIES 3
Highlighted

Re: Automate Impala views on Hive external table

I don't have insight into how to solve your particular problem, but for what it's worth, in later versions of Impala (those included in CDP), Impala will read recursively from directories within the table location.

Highlighted

Re: Automate Impala views on Hive external table

@Tim Thanks for the answer.

Is there any jira ticket or something that i can track for this particular Impala upgrade.

Highlighted

Re: Automate Impala views on Hive external table

Don't have an account?
Coming from Hortonworks? Activate your account here