Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Impala Memory limit exceed

avatar
Visitor

hi there,

I have encountered a common error as follows:

Memory left in process limit: 180.41 GB
Memory left in query limit: -467.80 KB
Query(7e4794a439e5f26d:748d4c7c00000000): memory limit exceeded. Limit=1.00 GB Reservation=635.75 MB ReservationLimit=819.20 MB OtherMemory=388.71 MB Total=1.00 GB Peak=1.00 GB

I don't quite understand the difference between the "process limit" and "query limit", and what's the reservation memory for?

many thanks!

1 ACCEPTED SOLUTION

avatar
Frequent Visitor

Hi,

I'm not sure which situation you are indicating. Your query might been restricted by MEM_LIMIT. 

 

process limit: set by --mem-limit startup option

query limit: set by MEM_LIMIT in your query through impala-shell or jdbc...

plz check this reference: https://impala.apache.org/docs/build/html/topics/impala_mem_limit.html

View solution in original post

2 REPLIES 2

avatar
Frequent Visitor

Hi,

I'm not sure which situation you are indicating. Your query might been restricted by MEM_LIMIT. 

 

process limit: set by --mem-limit startup option

query limit: set by MEM_LIMIT in your query through impala-shell or jdbc...

plz check this reference: https://impala.apache.org/docs/build/html/topics/impala_mem_limit.html

avatar
Visitor

hi thanks for your reply,

it really help me a lot!