question Enforce User to use dedicated YARN queue. in Support Questions

Enforce User to use dedicated YARN queue.

Jatin_g — Fri, 16 Sep 2022 14:27:41 GMT

Hi Experts,

Need your suggestions:

How to enforce a user to submit a job in dedicated resource pool if nothing is mentioned during submission.

Whenever a user submits a job (without mentioning any queue name) , it should go in a dedicated queue defined by Admins.

Can we control it through YARN ACLs.

Jerry — Thu, 20 Jun 2019 17:14:59 GMT

Hi,

Yes, We can enforce a job to run in a particular queue based on user using placement policy.

We can define a secondary group for each user. Whenever the user submits a job will land on the secondary group queue.

reference Link: https://blog.cloudera.com/blog/2016/06/untangling-apache-hadoop-yarn-part-4-fair-scheduler-queue-basics/

Thanks
Jerry