CapacityScheduler - Job Priority preemption

[#1]

@Tim Hall

Is there any feature or functionality with capacity scheduler where it would provide resources to higher priority job which kicked off during lower priority large job which is comsuming most of the resources. Assuming same org and que.

[#2]

@Sunile Manjee

https://hadoop.apache.org/docs/r1.2.1/capacity_sch...

• Job Priorities - Queues optionally support job priorities (disabled by default). Within a queue, jobs with higher priority will have access to the queue's resources before jobs with lower priority. However, once a job is running, it will not be preempted for a higher priority job, premption is on the roadmap is currently not supported.

[#3]

http://hortonworks.com/blog/better-slas-via-resource-preemption-in-yarns-capacityscheduler/

[#4 · Accepted solution]

Here's some information for you regarding job preemption, there are some parameters you can tune now and others are on the roadmap. http://hortonworks.com/blog/better-slas-via-resour...

This is how you would turn job preemption on HDP 2.3 http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-...

[#5]

@Sunile Manjee are you still having issues with this? Can you accept the best answer or provide your own solution?