- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Refreshing multiple partitions in single query in Impala
- Labels:
-
Apache Impala
Created on ‎08-02-2018 11:52 PM - edited ‎09-16-2022 06:32 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Is there a way we can refresh multiple partitions in a single statement?.
What I am trying to execute is something like "refresh partition ( col in ('val1','val2',val3'......))".
So that I do not have to fire multiple refresh queries. If it is not present, are there plans to bring this feature anytime in the near future?.
Created ‎08-03-2018 09:50 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We looked at adding this a while back but ran into some technical issues around whether it should discover new partitions that would match the predicates: https://issues.apache.org/jira/browse/IMPALA-4105
We have a few people actively working on REFRESH/INVALIDATE and related issues, hoping to drastically improve the experience there.
Created ‎08-03-2018 09:50 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We looked at adding this a while back but ran into some technical issues around whether it should discover new partitions that would match the predicates: https://issues.apache.org/jira/browse/IMPALA-4105
We have a few people actively working on REFRESH/INVALIDATE and related issues, hoping to drastically improve the experience there.
Created ‎09-21-2018 01:08 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I would like this too. My use case is new data files written to existing partitions, so I'm not concerned with partition discovery.
Even having
REFRESH tabA PARTITION (...) PARTITION (...) PARTITION (...)
will be useful
