Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

how to restrict users from using all YARN Resources

Highlighted

how to restrict users from using all YARN Resources

Explorer

how to restrict users from using all YARN Resources?

 

I have external users whom I want to restrict from submitting huge MR jobs that could consume all CPU and vCore. I want to allot them 25% of the cluster resources. How can I achive this task in CM 5.4

 

Thanks

Jay

2 REPLIES 2
Highlighted

Re: how to restrict users from using all YARN Resources

Master Guru
Your scheduler allows you to configure this based on queue names or
usernames. Have you checked out the FairScheduler configuration at
http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-yarn/hadoop-yarn-site/FairScheduler.html#Config...

Re: how to restrict users from using all YARN Resources

Cloudera Employee
In the scheduler configs, you might want to set weights , maxResources, and ACLs on individual queues.
Karthik Kambatla
Software Engineer, Cloudera Inc.
Don't have an account?
Coming from Hortonworks? Activate your account here