Support Questions
Find answers, ask questions, and share your expertise

Automate Impala views on Hive external table

Highlighted

Automate Impala views on Hive external table

I have external tables in Hive with location set on recursive directories in HDFS. Since Impala doesn't not read data in such external hive tables. So I was looking for a way to create Impala Views on top of Hive tables. How can I automate Impala views so that they will reflect changes as soon as there is a change in Hive tables.

My Use case is: Whenever there is new Hive table in Metastore, Create Impala View on it. If Hive table is dropped, View Should be dropped too. Any changes in Hive table structure, should Update the existing Impala View.  Basically keeping sync between Hive tables and Impala Views. 

How can I trigger this automatic process.

3 REPLIES 3
Highlighted

Re: Automate Impala views on Hive external table

I don't have insight into how to solve your particular problem, but for what it's worth, in later versions of Impala (those included in CDP), Impala will read recursively from directories within the table location.

Re: Automate Impala views on Hive external table

@Tim Thanks for the answer.

Is there any jira ticket or something that i can track for this particular Impala upgrade.

Highlighted

Re: Automate Impala views on Hive external table