Skip to main content
newbieone
Silver ⭐️⭐️⭐️
August 19, 2022
Solved

How to Read Impala Memory Summary

Hi all,

 

I have generated a query and the summary of Memory as below.

Need your help to elaborate and how to read the summary.

Thank you.

 

Query(9c4786bd80e8ed20:1caa788500000000): Limit=3.00 GB Reservation=0 ReservationLimit=2.40 GB OtherMemory=0 Total=0 Peak=520.47 MB
ChethanYM
ChethanYMAnswer
Gold ⭐️
August 29, 2022

Hi,

 

After you run the query you need to look at the query profile to analyse the complete memory.

look for “Per node peak memory usage” in the profile to understand how much memory each host or impala daemon used to run this query.

 

For above snippet from your side it looks like this query has the 3gb max limit to run the query, this can be set at session level or in impala admission control pool. If you provide the complete query profile i think we can get more details.

Regards,

Chethan YM

 

1 reply

ChethanYM
Gold ⭐️
ChethanYMAnswer
Gold ⭐️
August 29, 2022

Hi,

 

After you run the query you need to look at the query profile to analyse the complete memory.

look for “Per node peak memory usage” in the profile to understand how much memory each host or impala daemon used to run this query.

 

For above snippet from your side it looks like this query has the 3gb max limit to run the query, this can be set at session level or in impala admission control pool. If you provide the complete query profile i think we can get more details.

Regards,

Chethan YM

 

Translate