Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Impala Memory limit exceeded for a very simple query

Re: Impala Memory limit exceeded for a very simple query

Master Collaborator
Highlighted

Re: Impala Memory limit exceeded for a very simple query

Explorer

No, we aren't using YARN integration mode. 

Yarn has been configured for yarn processes and spark jobs only. Also to ensure sufficient memory is available, we aren't triggering any job when impala-query is being executed. 

Re: Impala Memory limit exceeded for a very simple query

Explorer

Hi,

 

Did you get a chance to discuss the issue with your colleage, regarding resource allocation. 

 

-Rgds,

Ankit

Re: Impala Memory limit exceeded for a very simple query

Cloudera Employee
Tim is right. This is almost certainly one of the known issues with Impala's previous YARN integration (via Llama). There were some fixes to that code in Impala 2.4 but you could still get this sort of unexpected failure. It's recommended that you do not use Impala on YARN, and instead to statically allocate resources to Impala for the time being. Cloudera Manager has a feature called "Static Service Pools" that can help with that, but it's not necessary. The CM documentation has more information.

We are working on improving Impala resource management, but it's going to take some time and we don't yet have a target release yet.

Best,
Matt
Don't have an account?
Coming from Hortonworks? Activate your account here