- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Yarn memory is zero
- Labels:
-
Apache YARN
Created on ‎06-01-2018 10:45 AM - edited ‎08-17-2019 08:36 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Can someone guide me on why YARN is utilizing zero out of 16.5 ? If this is an error how can I fix this ?
Created ‎06-01-2018 11:04 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You can get detailed explaination about Yarn "Cluster Memory" in the following thread.
Regaarding 0 (Zero Memory utiliaztion). Until you run a job you wont see the memory being utilized.
So please try running some job like following and then refresh the ambari Yarn dashboard.
# su - spark # export SPARK_MAJOR_VERSION=2 # cd /usr/hdp/current/spark2-client # ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client --num-executors 3 --driver-memory 512m --executor-memory 512m --executor-cores 1 examples/jars/spark-examples*.jar 10
.
Created ‎06-01-2018 11:04 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You can get detailed explaination about Yarn "Cluster Memory" in the following thread.
Regaarding 0 (Zero Memory utiliaztion). Until you run a job you wont see the memory being utilized.
So please try running some job like following and then refresh the ambari Yarn dashboard.
# su - spark # export SPARK_MAJOR_VERSION=2 # cd /usr/hdp/current/spark2-client # ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client --num-executors 3 --driver-memory 512m --executor-memory 512m --executor-cores 1 examples/jars/spark-examples*.jar 10
.
