Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Resource level restriction in YARN queue while submitting job
Labels:
New Contributor
Created ‎06-02-2022 02:23 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Team,
Hope you all are well
Can we implement a restriction in YARN queue in which user shouldn't be able to submit or user's Spark App/Job should be terminated/killed if the user allocates resources (VCores or MEM) beyond the threshold limit set.
Any suggestions or opinions will be appreciated
Thanks in advance 😊
2 REPLIES 2
Master Collaborator
Created ‎06-04-2022 03:32 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@learner94 You can make use of the capacity scheduler, Refer to the following docs for more info
New Contributor
Created ‎06-04-2022 03:39 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks @Scharan I will checkout this
