Reply
Expert Contributor
Posts: 131
Registered: ‎08-08-2013

How to configure YARN default queue per user ?

Hi,

I am using Capacity scheduler and I want to configure different default queues for different users,

so that e.g. if UserA submits a job, it will be put into queueA automatically...and if UserB submits a job it will be put into queueB automatically.

 

What are the configuration properties to use for ?

 

Many thanks, regards..Gerd..

Highlighted
Posts: 1,880
Kudos: 422
Solutions: 297
Registered: ‎07-31-2013

Re: How to configure YARN default queue per user ?

FairScheduler provides automatic queue placement rule configuration: http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-yarn/hadoop-yarn-site/FairScheduler.html#Automa...

CapacityScheduler does not have this feature at the moment, and continues to require users to explicitly state their queue. I suppose the only way to get some form of automation with CS would be to set different default config dirs for every user, each of which can have an altered default queue name configured in it.
Announcements