Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

When i set the scheduler from program, it impact the cluster or any other jobs submitted same time.?

avatar
Rising Star

Hi,

 

My cluster is using Capacity scheduler.

 

But, in my mapreduce program, i have used the below configuration

 

conf.set("yarn.resourcemanager.scheduler.class", "org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler");

 

to set the the scheduler class to Fair scheduler.

 

1) Does this change really take place.? as the configuration and resources are designed for capacity scheduler, does it really change the things for my application.?

 

2) What happens if any one submits other application at the same time.? Does this change have any impact on the other jobs.? As far as my understanding goes, NO..

 

Thank You..

Srini.

1 ACCEPTED SOLUTION

avatar
Super Collaborator

This change will not happen. You can not change the scheduler without restarting the resource manager.

It is not a job configurable setting but a server side setting only read on startup.

 

Wilfred

View solution in original post

1 REPLY 1

avatar
Super Collaborator

This change will not happen. You can not change the scheduler without restarting the resource manager.

It is not a job configurable setting but a server side setting only read on startup.

 

Wilfred