Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Preemption not working as expected in Yarn-2.7.3


Preemption not working as expected in Yarn-2.7.3

New Contributor



Our cluster uses Hadoop-2.7.3 with preemption enabled fair scheduler. There are multiple groups sharing the cluster and each group has been assigned different amounts of resources.

The issue is that, when the cluster is busy, a new job is submitted and following happen

  1. Jobs from the same queue are preempted;
  2. Too many jobs are preempted for this new job;
  3. Resource preempted from same job may goes back to the same job, similar as described in

Any suggestions on this? Or, any fix we should pick from current ymaster?

Thank you


Don't have an account?
Coming from Hortonworks? Activate your account here