Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created on 04-16-2019 07:57 AM - edited 09-16-2022 07:18 AM
Hi Friends,
I am trying to run IMPALA queries using query options. I am trying to analyze the resultant query attributes.
What I have observed that when I run the query for the first time, it took long time than I run the query second time or onwards.
I want to know the reason behind difference in time?
Does this happen only when table statistics are not available or it happens all the time.
Is my observation right?
Created 04-17-2019 06:00 PM
Created 04-16-2019 08:32 AM
Created 04-16-2019 04:30 PM
Impala caches all table metadata, so planning is generally faster once the table has been referenced by a previous query. You can see the "Planner Timeline" in the IMpala query profile to get a time breakdown of planning including metadata loading.
Created 04-17-2019 04:40 AM
Thanks Tim,
How long Impala keeps/caches this metadata?
If statistics of tables which are participating in query are not available then will it be available after first run?
What if I run the query after big interval, then also will metadata be available in cache?
What is my cluster or Impala is restarted?
Does Impala perform some activity to get statistics of all the participating tables for the first time if statistics are not available and keep it in metastore or some where in DB?
Created 04-17-2019 06:00 PM