Member since
12-10-2015
1
Post
0
Kudos Received
0
Solutions
05-20-2016
08:38 AM
There is only one setting in UI where you can change scheduler class. Go to Ambari->YARN->Configs->Advanced->Scheduler. In case of the FairScheduler, here it is: yarn.resourcemanager.scheduler.class. it should be set, as @Jonas Straub mentioned, to 'org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler'. But if you want to define some queues, after setting/saving new scheduler type, go to server where the YARN resource manager is running (it could be pull off from Ambari YARN page) and find the folder that contains file 'yarn-site.xml', put there file 'fair-scheduler.xml' with content: <?xml version="1.0"?>
<allocations>
<queue name="default">
<weight>30</weight>
<schedulingPolicy>fair</schedulingPolicy>
</queue>
<queue name="system_queue">
<weight>70</weight>
<schedulingPolicy>fifo</schedulingPolicy>
</queue>
<queuePlacementPolicy>
<rule name="specified" create="false" />
<rule name="default" queue="default" />
</queuePlacementPolicy>
</allocations>
here 30:70 ration is treated as fair :). Adjust it according to your needs and don't forget to restart YARN in Ambari. To verify your changes, go to Ambari->YARN->Quick Links->ResourceManager UI and navigate to Scheduler on the left side. There you should see your scheduler type and queue configuration. If you still have any questions, don't hesitate to ask.
... View more