- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Preventing users from Killing the yarn application
- Labels:
-
Apache YARN
Created ‎05-13-2017 09:44 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
As a Hadoop Admin, I don't want any other user to kill the yarn application except admin or only user who is owner of the job should be able to kill including admin. Any way to accomplish it ?
Presently anyone can kill the application .
Created ‎05-14-2017 08:12 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
hi @Sushant,
The easy approach is to use the Yarn queue manager from ambari views.
Alternatively you can control by setting the following parameter in capacity-scheduler.xml
yarn.scheduler.capacity.root.acl_administer_queue -- <comma separated admin userlist> <comma separated group list>
yarn.scheduler.capacity.root.acl_administer_queue -- admin-user,hdfs,hive admin-group
* please ensure you have a space between users and groups.
Created ‎05-13-2017 02:10 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @Sushant,
You can control access to Yarn Queues, including who can kill applications, with access control lists (ACL's). Read more about this in the docs.
/W
Created ‎05-13-2017 03:10 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Ward, Thanks for your inputs. I went through the docs and saw some property related to acl queues . May I know the difference between yarn.admin.acl property and ones mentioned in the link given by you.How do I restrict user 1 to kill jobs submitted by user 2 and vice versa ?
Created ‎05-14-2017 08:20 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
you need the set the ACLs for user as "%user" instead of user name, that will ensure that only the user who submitted the job only can kill in addition to that you can give access to other admin users to manage.
this will substitute the user name and the job can be killed only by the own user and admins.
yarn.scheduler.capacity.root.acl_administer_queue -- %user,hdfs,admin
Created ‎05-14-2017 08:12 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
hi @Sushant,
The easy approach is to use the Yarn queue manager from ambari views.
Alternatively you can control by setting the following parameter in capacity-scheduler.xml
yarn.scheduler.capacity.root.acl_administer_queue -- <comma separated admin userlist> <comma separated group list>
yarn.scheduler.capacity.root.acl_administer_queue -- admin-user,hdfs,hive admin-group
* please ensure you have a space between users and groups.
Created ‎05-14-2017 09:02 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks for your inputs. Will %user will prevent killing jobs both from command line and RM UI ?
Created ‎05-17-2017 04:24 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi, This worked . May I know , how to prevent user 1 to see applications submitted by themselves not others and admin should be able to view all jobs ?
Created ‎05-21-2017 10:20 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @Sushant
Glad that worked for you, in case can you please accept that answer.
in response to control the resource monitoring, not that I am aware of, but I believe you may 'not' need to prevent user 1 to see the application submitted by user1 or other user. as this does not contain any data (unless explisitly prints out to STDOUT).
on the other hand you can manage the access with (authorization)SPNEGO for web UI.
