Is it possible to set this parameter from Cloudera Express 5.14.1 UI?
I highly suspect Yarn to kill some spark executor before they can properly end.
Based on the link provided
Please help me understand this.
If a pending container needs 10G of RAM, but each containers in a queue over its fair share is less that 10G of RAM, none will be preempted. Is this a correct statement based on the above bullet
Mulitple containers get preempted to fulfill the need of one big container provided those small containers are running in the queue over fair share and other conditions make it eligile for preepmption as mentioned in the link.
So if there are two 5gb containers from that queue on a node that can be preempted, then that will be preempted and assigned to this 10GB ram container on other starved queue.