Yarn Capacity Scheduler: Share resource between users and queues

[#1]

Hi,

I am having some trouble settings the following scheduler queues params:

have 2 queue Dev and Prod

• Root 100%
  
  • Dev 30%
  • Prod 70%

(if only one used it should act as 100% of cluster)

Each queue is used by multiple users and resources should be shared equally, but when only one user exists(in each queue) it should use the entire capacity of the queue. And if the user alone in the cluster it should use 100% of the cluster in case of second user join, the scheduler should share the available resources

example flow:

• cluster is free of jobs
• user A submit job at queue Dev. (it now uses 100% of the cluster)
• user B submit job at queue Dev (it hangs in accepted)

i want that the users will share the capacity of the cluster, each should receive 50%

[#2]

@Ilia K
What maintenance is needed ? You can use user mapping in order to set which user will use which queue....

[#3]

thakyou it vry nice blog for beginners

https://www.emexotechnologies.com/courses/big-data-analytics-training/big-data-hadoop-training/