Reply
New Contributor
Posts: 1
Registered: ‎05-29-2019
Accepted Solution

Enforce User to use dedicated YARN queue.

[ Edited ]

Hi Experts,

 

Need your suggestions:

 

How to enforce a user to submit a job in dedicated resource pool if nothing is mentioned during submission.

 

Whenever a user submits a  job (without mentioning any queue name) , it should go in a dedicated queue defined by Admins.

 

Can we control it through YARN ACLs.

Highlighted
Posts: 49
Topics: 0
Kudos: 13
Solutions: 5
Registered: ‎07-30-2018

Re: Enforce User to use dedicated YARN queue.

Hi,

Yes, We can enforce a job to run in a particular queue based on user using placement policy.

We can define a secondary group for each user. Whenever the user submits a job will land on the secondary group queue.

reference Link: https://blog.cloudera.com/blog/2016/06/untangling-apache-hadoop-yarn-part-4-fair-scheduler-queue-bas...

Thanks
Jerry