Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Enforce User to use dedicated YARN queue.

SOLVED Go to solution

Enforce User to use dedicated YARN queue.

New Contributor

Hi Experts,

 

Need your suggestions:

 

How to enforce a user to submit a job in dedicated resource pool if nothing is mentioned during submission.

 

Whenever a user submits a  job (without mentioning any queue name) , it should go in a dedicated queue defined by Admins.

 

Can we control it through YARN ACLs.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Enforce User to use dedicated YARN queue.

Rising Star
Hi,

Yes, We can enforce a job to run in a particular queue based on user using placement policy.

We can define a secondary group for each user. Whenever the user submits a job will land on the secondary group queue.

reference Link: https://blog.cloudera.com/blog/2016/06/untangling-apache-hadoop-yarn-part-4-fair-scheduler-queue-bas...

Thanks
Jerry
1 REPLY 1

Re: Enforce User to use dedicated YARN queue.

Rising Star
Hi,

Yes, We can enforce a job to run in a particular queue based on user using placement policy.

We can define a secondary group for each user. Whenever the user submits a job will land on the secondary group queue.

reference Link: https://blog.cloudera.com/blog/2016/06/untangling-apache-hadoop-yarn-part-4-fair-scheduler-queue-bas...

Thanks
Jerry