Enforce User to use dedicated YARN queue.

[#1]

Hi Experts,

Need your suggestions:

How to enforce a user to submit a job in dedicated resource pool if nothing is mentioned during submission.

Whenever a user submits a  job (without mentioning any queue name) , it should go in a dedicated queue defined by Admins.

Can we control it through YARN ACLs.

[#2 · Accepted solution]

Hi,

Yes, We can enforce a job to run in a particular queue based on user using placement policy.

We can define a secondary group for each user. Whenever the user submits a job will land on the secondary group queue.

reference Link: https://blog.cloudera.com/blog/2016/06/untangling-apache-hadoop-yarn-part-4-fair-scheduler-queue-bas...

Thanks
Jerry