Member since
03-16-2016
5
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3090 | 06-15-2016 04:01 AM |
06-15-2016
04:01 AM
Fixed. Corrected by changing the YARN configuration: yarn.resourcemanager.scheduler.class from FifoScheduler to FairScheduler
... View more
06-14-2016
08:54 AM
Hello. We are having a problem where all the jobs we run on YARN are ending on a pool called default that we didn't create it. This happens for hive, spark, etc. Our Dynamic Resource Pool Configuration is: root root.myuser And our placement rules only has one entry: root.<username> pool; create the pool if it doesn't exist We don't understand how can the jobs end in the default pool. Relevant configs: yarn.scheduler.fair.user-as-default-queue [x] ResourceManager Default Group yarn.scheduler.fair.allow-undeclared-pools [x] YARN (MR2 Included) (Service-Wide)
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Spark
-
Apache YARN