- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
yarn.scheduler.fair.user-as-default-queue - Not working
- Labels:
-
Apache Impala
-
Apache YARN
-
Cloudera Manager
Created on ‎06-06-2017 08:33 AM - edited ‎09-16-2022 04:42 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
I've got many applications sat running under the default queue, which does not make sense to me as I've set:
yarn.scheduler.fair.user-as-default-queue - True
From my understanding this should mean that is a job runs under user XYZ, then as long as I have a dynamic resource pool named XYZ the job should utlize that pool? Am i misunderstaning something?
Currently using fair scheudler.
ANy help would be great!
Thanks,
Chris
Created ‎06-07-2017 01:02 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
perfect thank you, that was the issue. I needed to add the placement rule "Use the pool root.[Username], only if the pool exists".
Created ‎06-06-2017 10:33 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The Hadoop docs do have this note regarding the settings. That is why I asked about the placement rules you have.
"If a queue placement policy is given in the allocations file, this property is ignored."
https://hadoop.apache.org/docs/r2.4.1/hadoop-yarn/hadoop-yarn-site/FairScheduler.html
Created ‎06-07-2017 01:02 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
perfect thank you, that was the issue. I needed to add the placement rule "Use the pool root.[Username], only if the pool exists".
