Impala Memory limit exceeded for a very simple query

[#1]

The correct link is: http://community.cloudera.com/t5/Interactive-Short-cycle-SQL/Impala-memory-issue-Query-did-not-have-...

[#2]

No, we aren't using YARN integration mode. 

Yarn has been configured for yarn processes and spark jobs only. Also to ensure sufficient memory is available, we aren't triggering any job when impala-query is being executed. 

[#3]

Hi,

Did you get a chance to discuss the issue with your colleage, regarding resource allocation. 

-Rgds,

Ankit

[#4]

Tim is right. This is almost certainly one of the known issues with Impala's previous YARN integration (via Llama). There were some fixes to that code in Impala 2.4 but you could still get this sort of unexpected failure. It's recommended that you do not use Impala on YARN, and instead to statically allocate resources to Impala for the time being. Cloudera Manager has a feature called "Static Service Pools" that can help with that, but it's not necessary. The CM documentation has more information.

We are working on improving Impala resource management, but it's going to take some time and we don't yet have a target release yet.

Best,
Matt