Created 10-21-2020 01:51 AM
I have external tables in Hive with location set on recursive directories in HDFS. Since Impala doesn't not read data in such external hive tables. So I was looking for a way to create Impala Views on top of Hive tables. How can I automate Impala views so that they will reflect changes as soon as there is a change in Hive tables.
My Use case is: Whenever there is new Hive table in Metastore, Create Impala View on it. If Hive table is dropped, View Should be dropped too. Any changes in Hive table structure, should Update the existing Impala View. Basically keeping sync between Hive tables and Impala Views.
How can I trigger this automatic process.
Created 10-21-2020 09:49 PM
I don't have insight into how to solve your particular problem, but for what it's worth, in later versions of Impala (those included in CDP), Impala will read recursively from directories within the table location.
Created 10-23-2020 01:10 AM
@Tim Thanks for the answer.
Is there any jira ticket or something that i can track for this particular Impala upgrade.
Created 10-23-2020 10:28 AM
https://issues.apache.org/jira/browse/IMPALA-8454 is the apache impala jira