Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

After upgrading to HDP 2.6.1 the system is not using Yarn default queue as default queue

After upgrading to HDP 2.6.1 the system is not using Yarn default queue as default queue

New Contributor

Hello We had setup 3 queues -

default (minimum 30% maximum 100% - priority 0 and ordering policy - FIFO)

queue 1 ( minimum 35% maximum 35% - priority 0 and ordering policy - FIFO)

queue 2 ( minimum 35% maximum 100% - priority 0 and ordering policy - FIFO)

before upgrade all the jobs were by default assigned to default queue. After the upgrade all the jobs are going to queue 1.

How do I make sure that all the jobs by default goes to default queue instead of other queue unless it is specified.

3 REPLIES 3

Re: After upgrading to HDP 2.6.1 the system is not using Yarn default queue as default queue

Ping @ssathish

Highlighted

Re: After upgrading to HDP 2.6.1 the system is not using Yarn default queue as default queue

Hi @bhavik shah,

Can you please share the capacity-scheduler.xml file?

In that please check, if the default queue is stopped or not?

Re: After upgrading to HDP 2.6.1 the system is not using Yarn default queue as default queue

New Contributor
yarn.scheduler.capacity.maximum-am-resource-percent=0.2
yarn.scheduler.capacity.maximum-applications=10000
yarn.scheduler.capacity.node-locality-delay=40
yarn.scheduler.capacity.root.accessible-node-labels=*
yarn.scheduler.capacity.root.acl_administer_queue=*
yarn.scheduler.capacity.root.capacity=100
yarn.scheduler.capacity.root.default.acl_submit_applications=*
yarn.scheduler.capacity.root.default.capacity=35
yarn.scheduler.capacity.root.default.maximum-capacity=100
yarn.scheduler.capacity.root.default.state=RUNNING
yarn.scheduler.capacity.root.default.user-limit-factor=1
yarn.scheduler.capacity.root.queues=ds,default,sp
yarn.scheduler.capacity.queue-mappings-override.enable=false
yarn.scheduler.capacity.root.ds.acl_administer_queue=*
yarn.scheduler.capacity.root.ds.acl_submit_applications=*
yarn.scheduler.capacity.root.ds.capacity=35
yarn.scheduler.capacity.root.ds.ds1.acl_administer_queue=*
yarn.scheduler.capacity.root.ds.ds1.acl_submit_applications=*
yarn.scheduler.capacity.root.ds.ds1.capacity=50
yarn.scheduler.capacity.root.ds.ds1.maximum-capacity=100
yarn.scheduler.capacity.root.ds.ds1.minimum-user-limit-percent=100
yarn.scheduler.capacity.root.ds.ds1.ordering-policy=fair
yarn.scheduler.capacity.root.ds.ds1.ordering-policy.fair.enable-size-based-weight=false
yarn.scheduler.capacity.root.ds.ds1.priority=0
yarn.scheduler.capacity.root.ds.ds1.state=RUNNING
yarn.scheduler.capacity.root.ds.ds1.user-limit-factor=3
yarn.scheduler.capacity.root.ds.ds2.acl_administer_queue=*
yarn.scheduler.capacity.root.ds.ds2.acl_submit_applications=*
yarn.scheduler.capacity.root.ds.ds2.capacity=50
yarn.scheduler.capacity.root.ds.ds2.maximum-capacity=100
yarn.scheduler.capacity.root.ds.ds2.minimum-user-limit-percent=100
yarn.scheduler.capacity.root.ds.ds2.ordering-policy=fair
yarn.scheduler.capacity.root.ds.ds2.ordering-policy.fair.enable-size-based-weight=false
yarn.scheduler.capacity.root.ds.ds2.priority=0
yarn.scheduler.capacity.root.ds.ds2.state=RUNNING
yarn.scheduler.capacity.root.ds.ds2.user-limit-factor=3
yarn.scheduler.capacity.root.ds.maximum-capacity=100
yarn.scheduler.capacity.root.ds.minimum-user-limit-percent=100
yarn.scheduler.capacity.root.ds.priority=0
yarn.scheduler.capacity.root.ds.queues=ds1,ds2
yarn.scheduler.capacity.root.ds.state=RUNNING
yarn.scheduler.capacity.root.ds.user-limit-factor=2
yarn.scheduler.capacity.root.default.ordering-policy=fair
yarn.scheduler.capacity.root.default.ordering-policy.fair.enable-size-based-weight=false
yarn.scheduler.capacity.root.default.priority=0
yarn.scheduler.capacity.root.maximum-capacity=100
yarn.scheduler.capacity.root.priority=0
yarn.scheduler.capacity.root.sp.acl_administer_queue=*
yarn.scheduler.capacity.root.sp.acl_submit_applications=*
yarn.scheduler.capacity.root.sp.capacity=30
yarn.scheduler.capacity.root.sp.maximum-capacity=30
yarn.scheduler.capacity.root.sp.minimum-user-limit-percent=100
yarn.scheduler.capacity.root.sp.ordering-policy=fair
yarn.scheduler.capacity.root.sp.ordering-policy.fair.enable-size-based-weight=false
yarn.scheduler.capacity.root.sp.priority=0
yarn.scheduler.capacity.root.sp.state=RUNNING
yarn.scheduler.capacity.root.sp.user-limit-factor=1



Don't have an account?
Coming from Hortonworks? Activate your account here