Reply
Highlighted
Contributor
Posts: 55
Registered: ‎09-17-2013
Accepted Solution

When i set the scheduler from program, it impact the cluster or any other jobs submitted same time.?

Hi,

 

My cluster is using Capacity scheduler.

 

But, in my mapreduce program, i have used the below configuration

 

conf.set("yarn.resourcemanager.scheduler.class", "org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler");

 

to set the the scheduler class to Fair scheduler.

 

1) Does this change really take place.? as the configuration and resources are designed for capacity scheduler, does it really change the things for my application.?

 

2) What happens if any one submits other application at the same time.? Does this change have any impact on the other jobs.? As far as my understanding goes, NO..

 

Thank You..

Srini.

Cloudera Employee
Posts: 306
Registered: ‎01-16-2014

Re: When i set the scheduler from program, it impact the cluster or any other jobs submitted same ti

This change will not happen. You can not change the scheduler without restarting the resource manager.

It is not a job configurable setting but a server side setting only read on startup.

 

Wilfred

Announcements