https://community.cloudera.com/t5/Archives-of-Support-Questions/CapacityScheduler-Job-Priority-preemption/m-p/101366#M14064 <P><A href="http://hortonworks.com/blog/better-slas-via-resource-preemption-in-yarns-capacityscheduler/">http://hortonworks.com/blog/better-slas-via-resource-preemption-in-yarns-capacityscheduler/</A></P> Tue, 05 Jan 2016 21:03:49 GMT nsabharwal 2016-01-05T21:03:49Z https://community.cloudera.com/t5/Archives-of-Support-Questions/CapacityScheduler-Job-Priority-preemption/m-p/101364#M14062 <P><A href="https://community.hortonworks.com/questions/ask.html#">@Tim Hall</A></P><P>Is there any feature or functionality with capacity scheduler where it would provide resources to higher priority job which kicked off during lower priority large job which is comsuming most of the resources. Assuming same org and que.</P> Tue, 05 Jan 2016 12:39:56 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/CapacityScheduler-Job-Priority-preemption/m-p/101364#M14062 sunile_manjee 2016-01-05T12:39:56Z https://community.cloudera.com/t5/Archives-of-Support-Questions/CapacityScheduler-Job-Priority-preemption/m-p/101365#M14063 <A rel="user" href="https://community.cloudera.com/users/1486/smanjee.html" nodeid="1486">@Sunile Manjee</A><P><A href="https://hadoop.apache.org/docs/r1.2.1/capacity_scheduler.html">https://hadoop.apache.org/docs/r1.2.1/capacity_sch...</A></P><UL> <LI>Job Priorities - Queues optionally support job priorities (disabled by default). Within a queue, jobs with higher priority will have access to the queue's resources before jobs with lower priority. However, once a job is running, it will not be preempted for a higher priority job, <EM>premption</EM> is on the roadmap is currently not supported.</LI></UL> Tue, 05 Jan 2016 20:58:53 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/CapacityScheduler-Job-Priority-preemption/m-p/101365#M14063 nsabharwal 2016-01-05T20:58:53Z https://community.cloudera.com/t5/Archives-of-Support-Questions/CapacityScheduler-Job-Priority-preemption/m-p/101366#M14064 <P><A href="http://hortonworks.com/blog/better-slas-via-resource-preemption-in-yarns-capacityscheduler/">http://hortonworks.com/blog/better-slas-via-resource-preemption-in-yarns-capacityscheduler/</A></P> Tue, 05 Jan 2016 21:03:49 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/CapacityScheduler-Job-Priority-preemption/m-p/101366#M14064 nsabharwal 2016-01-05T21:03:49Z https://community.cloudera.com/t5/Archives-of-Support-Questions/CapacityScheduler-Job-Priority-preemption/m-p/101367#M14065 <P> Here's some information for you regarding job preemption, there are some parameters you can tune now and others are on the roadmap. <A href="http://hortonworks.com/blog/better-slas-via-resource-preemption-in-yarns-capacityscheduler/">http://hortonworks.com/blog/better-slas-via-resour...</A> </P><P>This is how you would turn job preemption on HDP 2.3 <A href="http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_yarn_resource_mgt/content/preemption.html">http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-...</A></P> Tue, 05 Jan 2016 21:57:17 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/CapacityScheduler-Job-Priority-preemption/m-p/101367#M14065 aervits 2016-01-05T21:57:17Z https://community.cloudera.com/t5/Archives-of-Support-Questions/CapacityScheduler-Job-Priority-preemption/m-p/101368#M14066 <P><A rel="user" href="https://community.cloudera.com/users/1486/smanjee.html" nodeid="1486">@Sunile Manjee</A> are you still having issues with this? Can you accept the best answer or provide your own solution?</P> Wed, 03 Feb 2016 05:25:52 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/CapacityScheduler-Job-Priority-preemption/m-p/101368#M14066 aervits 2016-02-03T05:25:52Z