Reply
Explorer
Posts: 6
Registered: ‎05-18-2014

Restrict user from submitting Jobs

Team,

 

Is it possible to restrict certain users from submitting jobs with Yarn in CDH5.

 

-Eldo-

Expert Contributor
Posts: 126
Registered: ‎11-01-2013

Re: Restrict user from submitting Jobs

Assign 0 mappers and 0 reducers to that user in your fair scheduler configuration. This probably not allow that user to run jobs...
This may not be the perfect answer but this may work...
Em Jay
Cloudera Employee
Posts: 294
Registered: ‎01-16-2014

Re: Restrict user from submitting Jobs

It depends on the scheduler you are using.

For the fair scheduler which is currently the only supported scheduler in CDH 5 you can achieve it in a number of ways.

If you have queue based on user names then you could set the max applications for the user (mappers and reducers is not a YARN queue thing) in the allocations file:

<user name="forbidden_user"> <maxRunningApps>0</maxRunningApps> </user>

 

The other solution would be to use a 'reject' as the last rule in the queue placement policy and make sure that the user does not match any of the earlier rules.

 

If you really want to you could use queue ACLs also.

 

For all these options see here: http://hadoop.apache.org/docs/r2.3.0/hadoop-yarn/hadoop-yarn-site/FairScheduler.html

 

Wilfred

Announcements