Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 05-01-2017 09:38 PM
Hi - i'm running a Beeline query, and it is not getting launched.
Query :
beeline -u jdbc:hive2://nwk2-bdp-hadoop-07.gdcs-qa.apple.com:10000/default -n hive -e "INSERT INTO factsales SELECT * FROM factsales_tmp"
Error on the Resource Manager UI is as shown ->
--------------------------------
[Mon May 01 21:31:00 +0000 2017] Application is added to the scheduler and is not yet activated. Queue's AM resource limit exceeded. Details : AM Partition = <DEFAULT_PARTITION>; AM Resource Request = <memory:2048, vCores:1>; Queue Resource Limit for AM = <memory:2048, vCores:1>; User AM Resource Limit of the queue = <memory:2048, vCores:1>; Queue AM Resource Usage = <memory:2048, vCores:1>;
--------------------------------
The Execution engine is - MapReduce
Also, This is using default queue. I've another queue - llap which is used to run Hiveserver2 Intearctive (% of Cluster Capacity = 40%)
Any ideas on what needs to be done/tweaked for this ?
Created 05-01-2017 09:54 PM
What is the value of yarn.scheduler.capacity.maximum-am-resource-percent in your cluster? The default value is usually 0.2. Try increasing it and see if your job moves forward.
Created 05-01-2017 09:45 PM
@Neeraj Sabharwal, @mqureshi, @Artem Ervits -looping you in, any ideas on this ?
Created 05-01-2017 09:54 PM
What is the value of yarn.scheduler.capacity.maximum-am-resource-percent in your cluster? The default value is usually 0.2. Try increasing it and see if your job moves forward.
Created 05-01-2017 10:36 PM
@Gour Saha - thanks, that setting fixed the issue !