Support Questions
Find answers, ask questions, and share your expertise

Enforce User to use dedicated YARN queue.

New Contributor

Hi Experts,

 

Need your suggestions:

 

How to enforce a user to submit a job in dedicated resource pool if nothing is mentioned during submission.

 

Whenever a user submits a  job (without mentioning any queue name) , it should go in a dedicated queue defined by Admins.

 

Can we control it through YARN ACLs.

1 ACCEPTED SOLUTION

Rising Star
Hi,

Yes, We can enforce a job to run in a particular queue based on user using placement policy.

We can define a secondary group for each user. Whenever the user submits a job will land on the secondary group queue.

reference Link: https://blog.cloudera.com/blog/2016/06/untangling-apache-hadoop-yarn-part-4-fair-scheduler-queue-bas...

Thanks
Jerry

View solution in original post

1 REPLY 1

Rising Star
Hi,

Yes, We can enforce a job to run in a particular queue based on user using placement policy.

We can define a secondary group for each user. Whenever the user submits a job will land on the secondary group queue.

reference Link: https://blog.cloudera.com/blog/2016/06/untangling-apache-hadoop-yarn-part-4-fair-scheduler-queue-bas...

Thanks
Jerry
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.