Support Questions
Find answers, ask questions, and share your expertise

Enforce User to use dedicated YARN queue.

Solved Go to solution
Highlighted

Enforce User to use dedicated YARN queue.

New Contributor

Hi Experts,

 

Need your suggestions:

 

How to enforce a user to submit a job in dedicated resource pool if nothing is mentioned during submission.

 

Whenever a user submits a  job (without mentioning any queue name) , it should go in a dedicated queue defined by Admins.

 

Can we control it through YARN ACLs.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Enforce User to use dedicated YARN queue.

Rising Star
Hi,

Yes, We can enforce a job to run in a particular queue based on user using placement policy.

We can define a secondary group for each user. Whenever the user submits a job will land on the secondary group queue.

reference Link: https://blog.cloudera.com/blog/2016/06/untangling-apache-hadoop-yarn-part-4-fair-scheduler-queue-bas...

Thanks
Jerry

View solution in original post

1 REPLY 1
Highlighted

Re: Enforce User to use dedicated YARN queue.

Rising Star
Hi,

Yes, We can enforce a job to run in a particular queue based on user using placement policy.

We can define a secondary group for each user. Whenever the user submits a job will land on the secondary group queue.

reference Link: https://blog.cloudera.com/blog/2016/06/untangling-apache-hadoop-yarn-part-4-fair-scheduler-queue-bas...

Thanks
Jerry

View solution in original post