Created 05-01-2017 09:38 PM
Hi - i'm running a Beeline query, and it is not getting launched.
Query :
beeline -u jdbc:hive2://nwk2-bdp-hadoop-07.gdcs-qa.apple.com:10000/default -n hive -e "INSERT INTO factsales SELECT * FROM factsales_tmp"
Error on the Resource Manager UI is as shown ->
--------------------------------
[Mon May 01 21:31:00 +0000 2017] Application is added to the scheduler and is not yet activated. Queue's AM resource limit exceeded. Details : AM Partition = <DEFAULT_PARTITION>; AM Resource Request = <memory:2048, vCores:1>; Queue Resource Limit for AM = <memory:2048, vCores:1>; User AM Resource Limit of the queue = <memory:2048, vCores:1>; Queue AM Resource Usage = <memory:2048, vCores:1>;
--------------------------------
The Execution engine is - MapReduce
Also, This is using default queue. I've another queue - llap which is used to run Hiveserver2 Intearctive (% of Cluster Capacity = 40%)
Any ideas on what needs to be done/tweaked for this ?
Created 05-01-2017 09:54 PM
What is the value of yarn.scheduler.capacity.maximum-am-resource-percent in your cluster? The default value is usually 0.2. Try increasing it and see if your job moves forward.
Created 05-01-2017 09:45 PM
@Neeraj Sabharwal, @mqureshi, @Artem Ervits -looping you in, any ideas on this ?
Created 05-01-2017 09:54 PM
What is the value of yarn.scheduler.capacity.maximum-am-resource-percent in your cluster? The default value is usually 0.2. Try increasing it and see if your job moves forward.
Created 05-01-2017 10:36 PM
@Gour Saha - thanks, that setting fixed the issue !