- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Automate Impala views on Hive external table
Created ‎10-21-2020 01:51 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have external tables in Hive with location set on recursive directories in HDFS. Since Impala doesn't not read data in such external hive tables. So I was looking for a way to create Impala Views on top of Hive tables. How can I automate Impala views so that they will reflect changes as soon as there is a change in Hive tables.
My Use case is: Whenever there is new Hive table in Metastore, Create Impala View on it. If Hive table is dropped, View Should be dropped too. Any changes in Hive table structure, should Update the existing Impala View. Basically keeping sync between Hive tables and Impala Views.
How can I trigger this automatic process.
Created ‎10-21-2020 09:49 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I don't have insight into how to solve your particular problem, but for what it's worth, in later versions of Impala (those included in CDP), Impala will read recursively from directories within the table location.
Created ‎10-23-2020 01:10 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Tim Thanks for the answer.
Is there any jira ticket or something that i can track for this particular Impala upgrade.
Created ‎10-23-2020 10:28 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
https://issues.apache.org/jira/browse/IMPALA-8454 is the apache impala jira
