Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Resource level restriction in YARN queue while submitting job

avatar
New Contributor

Hi Team,
Hope you all are well

Can we implement a restriction in YARN queue in which user shouldn't be able to submit or user's Spark App/Job should be terminated/killed if the user allocates resources (VCores or MEM) beyond the threshold limit set.

Any suggestions or opinions will be appreciated

Thanks in advance 😊

2 REPLIES 2

avatar
Master Collaborator

@learner94 You can make use of the capacity scheduler, Refer to the following docs for more info

 

https://docs.cloudera.com/cdp-private-cloud-base/7.1.3/yarn-allocate-resources/topics/yarn-allocatin...

avatar
New Contributor

Thanks @Scharan I will checkout this