Reply
Explorer
Posts: 12
Registered: ‎08-07-2017

Should we go for capacity scheduler instead of default scheduler?

Hello All,

 

We are currently using cloudera manager CDH 5.9 for production and CDH 5.4 for development.

 

Cluster is multitenant cluster with default fair scheduler for resource management.

 

Should we go for capacity scheduler deployment instead of fair scheduler?

 

Or we can use the default fair scheduler with configuration of queues and assigning min/max resources and weight instead.

 

Please suggest.

 

Thanks,

Priya

Highlighted
Posts: 352
Topics: 11
Kudos: 54
Solutions: 30
Registered: ‎09-02-2016

Re: Should we go for capacity scheduler instead of default scheduler?

@cdhhadoop

 

As you mentioned, the default is fair and cloudera recommends the default unless your business demands capacity scheduler. 

 

Pls refer this link for CDH 5.9 scheduler

 

https://www.cloudera.com/documentation/enterprise/5-9-x/topics/admin_schedulers.html

 

YARN - Cloudera Manager, CDH 5, and CDH 4 set the default to Fair Scheduler. Cloudera recommends Fair Scheduler. FIFO and Capacity Scheduler are also available.

Announcements