- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to Read Impala Memory Summary
- Labels:
-
Apache Hive
-
Apache Impala
Created 08-18-2022 05:18 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi all,
I have generated a query and the summary of Memory as below.
Need your help to elaborate and how to read the summary.
Thank you.
Query(9c4786bd80e8ed20:1caa788500000000): Limit=3.00 GB Reservation=0 ReservationLimit=2.40 GB OtherMemory=0 Total=0 Peak=520.47 MB
Created 08-29-2022 05:21 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
After you run the query you need to look at the query profile to analyse the complete memory.
look for “Per node peak memory usage” in the profile to understand how much memory each host or impala daemon used to run this query.
For above snippet from your side it looks like this query has the 3gb max limit to run the query, this can be set at session level or in impala admission control pool. If you provide the complete query profile i think we can get more details.
Regards,
Chethan YM
Created 08-29-2022 05:21 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
After you run the query you need to look at the query profile to analyse the complete memory.
look for “Per node peak memory usage” in the profile to understand how much memory each host or impala daemon used to run this query.
For above snippet from your side it looks like this query has the 3gb max limit to run the query, this can be set at session level or in impala admission control pool. If you provide the complete query profile i think we can get more details.
Regards,
Chethan YM
