Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Enforce User to use dedicated YARN queue.

avatar
New Contributor

Hi Experts,

 

Need your suggestions:

 

How to enforce a user to submit a job in dedicated resource pool if nothing is mentioned during submission.

 

Whenever a user submits a  job (without mentioning any queue name) , it should go in a dedicated queue defined by Admins.

 

Can we control it through YARN ACLs.

1 ACCEPTED SOLUTION

avatar
Expert Contributor
Hi,

Yes, We can enforce a job to run in a particular queue based on user using placement policy.

We can define a secondary group for each user. Whenever the user submits a job will land on the secondary group queue.

reference Link: https://blog.cloudera.com/blog/2016/06/untangling-apache-hadoop-yarn-part-4-fair-scheduler-queue-bas...

Thanks
Jerry

View solution in original post

1 REPLY 1

avatar
Expert Contributor
Hi,

Yes, We can enforce a job to run in a particular queue based on user using placement policy.

We can define a secondary group for each user. Whenever the user submits a job will land on the secondary group queue.

reference Link: https://blog.cloudera.com/blog/2016/06/untangling-apache-hadoop-yarn-part-4-fair-scheduler-queue-bas...

Thanks
Jerry