Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Refreshing multiple partitions in single query in Impala

Solved Go to solution

Refreshing multiple partitions in single query in Impala

Explorer

Is there a way we can refresh multiple partitions in a single statement?.

 

What I am trying to execute is something like "refresh partition ( col in ('val1','val2',val3'......))".

 

So that I do not have to fire multiple refresh queries. If it is not present, are there plans to bring this feature anytime in the near future?.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Refreshing multiple partitions in single query in Impala

Master Collaborator

We looked at adding this a while back but ran into some technical issues around whether it should discover new partitions that would match the predicates: https://issues.apache.org/jira/browse/IMPALA-4105

 

We have a few people actively working on REFRESH/INVALIDATE and related issues, hoping to drastically improve the experience there.

2 REPLIES 2

Re: Refreshing multiple partitions in single query in Impala

Master Collaborator

We looked at adding this a while back but ran into some technical issues around whether it should discover new partitions that would match the predicates: https://issues.apache.org/jira/browse/IMPALA-4105

 

We have a few people actively working on REFRESH/INVALIDATE and related issues, hoping to drastically improve the experience there.

Re: Refreshing multiple partitions in single query in Impala

New Contributor

I would like this too. My use case is new data files written to existing partitions, so I'm not concerned with partition discovery.

 

Even having 

 

REFRESH tabA
  PARTITION (...)
  PARTITION (...)
  PARTITION (...)

will be useful