When i set the scheduler from program, it impact the cluster or any other jobs submitted same time.?

Srini_D — Fri, 16 Sep 2022 09:39:11 GMT

Hi,

My cluster is using Capacity scheduler.

But, in my mapreduce program, i have used the below configuration

conf.set("yarn.resourcemanager.scheduler.class", "org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler");

to set the the scheduler class to Fair scheduler.

1) Does this change really take place.? as the configuration and resources are designed for capacity scheduler, does it really change the things for my application.?

2) What happens if any one submits other application at the same time.? Does this change have any impact on the other jobs.? As far as my understanding goes, NO..

Thank You..

Srini.

Re: When i set the scheduler from program, it impact the cluster or any other jobs submitted same ti

Wilfred — Wed, 26 Aug 2015 12:04:46 GMT

This change will not happen. You can not change the scheduler without restarting the resource manager.

It is not a job configurable setting but a server side setting only read on startup.

Wilfred

question Re: When i set the scheduler from program, it impact the cluster or any other jobs submitted same ti in Archives of Support Questions (Read Only)

When i set the scheduler from program, it impact the cluster or any other jobs submitted same time.?

Re: When i set the scheduler from program, it impact the cluster or any other jobs submitted same ti