Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

When i set the scheduler from program, it impact the cluster or any other jobs submitted same time.?

SOLVED Go to solution

When i set the scheduler from program, it impact the cluster or any other jobs submitted same time.?

Explorer

Hi,

 

My cluster is using Capacity scheduler.

 

But, in my mapreduce program, i have used the below configuration

 

conf.set("yarn.resourcemanager.scheduler.class", "org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler");

 

to set the the scheduler class to Fair scheduler.

 

1) Does this change really take place.? as the configuration and resources are designed for capacity scheduler, does it really change the things for my application.?

 

2) What happens if any one submits other application at the same time.? Does this change have any impact on the other jobs.? As far as my understanding goes, NO..

 

Thank You..

Srini.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: When i set the scheduler from program, it impact the cluster or any other jobs submitted same ti

Super Collaborator

This change will not happen. You can not change the scheduler without restarting the resource manager.

It is not a job configurable setting but a server side setting only read on startup.

 

Wilfred

1 REPLY 1

Re: When i set the scheduler from program, it impact the cluster or any other jobs submitted same ti

Super Collaborator

This change will not happen. You can not change the scheduler without restarting the resource manager.

It is not a job configurable setting but a server side setting only read on startup.

 

Wilfred