08-09-2017 05:12 AM
We are currently using cloudera manager CDH 5.9 for production and CDH 5.4 for development.
Cluster is multitenant cluster with default fair scheduler for resource management.
Should we go for capacity scheduler deployment instead of fair scheduler?
Or we can use the default fair scheduler with configuration of queues and assigning min/max resources and weight instead.
08-09-2017 06:49 AM
As you mentioned, the default is fair and cloudera recommends the default unless your business demands capacity scheduler.
Pls refer this link for CDH 5.9 scheduler
YARN - Cloudera Manager, CDH 5, and CDH 4 set the default to Fair Scheduler. Cloudera recommends Fair Scheduler. FIFO and Capacity Scheduler are also available.