question Impala Memory limit exceed in Support Questions

Impala Memory limit exceed

oliverw — Fri, 21 Jan 2022 03:41:01 GMT

hi there,

I have encountered a common error as follows:

Memory left in process limit: 180.41 GB
Memory left in query limit: -467.80 KB
Query(7e4794a439e5f26d:748d4c7c00000000): memory limit exceeded. Limit=1.00 GB Reservation=635.75 MB ReservationLimit=819.20 MB OtherMemory=388.71 MB Total=1.00 GB Peak=1.00 GB

I don't quite understand the difference between the "process limit" and "query limit", and what's the reservation memory for?

many thanks!

Re: Impala Memory limit exceed

dennis_wang — Wed, 26 Jan 2022 09:23:12 GMT

Hi,

I'm not sure which situation you are indicating. Your query might been restricted by MEM_LIMIT.

process limit: set by --mem-limit startup option

query limit: set by MEM_LIMIT in your query through impala-shell or jdbc...

plz check this reference: https://impala.apache.org/docs/build/html/topics/impala_mem_limit.html

Re: Impala Memory limit exceed

oliverw — Wed, 26 Jan 2022 12:20:58 GMT

hi thanks for your reply,

it really help me a lot!