Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Should we go for capacity scheduler instead of default scheduler?

Should we go for capacity scheduler instead of default scheduler?

Contributor

Hello All,

 

We are currently using cloudera manager CDH 5.9 for production and CDH 5.4 for development.

 

Cluster is multitenant cluster with default fair scheduler for resource management.

 

Should we go for capacity scheduler deployment instead of fair scheduler?

 

Or we can use the default fair scheduler with configuration of queues and assigning min/max resources and weight instead.

 

Please suggest.

 

Thanks,

Priya

1 REPLY 1

Re: Should we go for capacity scheduler instead of default scheduler?

Champion

@cdhhadoop

 

As you mentioned, the default is fair and cloudera recommends the default unless your business demands capacity scheduler. 

 

Pls refer this link for CDH 5.9 scheduler

 

https://www.cloudera.com/documentation/enterprise/5-9-x/topics/admin_schedulers.html

 

YARN - Cloudera Manager, CDH 5, and CDH 4 set the default to Fair Scheduler. Cloudera recommends Fair Scheduler. FIFO and Capacity Scheduler are also available.