Reply
New Contributor
Posts: 3
Registered: ‎05-09-2017

Cloudera quick start VM

I recently downloaded cloudera quick start VM 10.When ever I start Spark services using Cloudera Manager it throws me below exception, is there a way to resolve it.

 

Tue May 9 21:45:56 PDT 2017
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Using -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/spark_on_yarn_spark-SPARK_YARN_HISTORY_SERVER_pid25402.hprof -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh as CSD_JAVA_OPTS
Using /var/run/cloudera-scm-agent/process/18-spark_on_yarn-SPARK_YARN_HISTORY_SERVER as conf dir
Using scripts/control.sh as process script
CONF_DIR=/var/run/cloudera-scm-agent/process/18-spark_on_yarn-SPARK_YARN_HISTORY_SERVER
CMF_CONF_DIR=/etc/cloudera-scm-agent
Tue May 9 21:45:56 PDT 2017: Running Spark CSD control script...
Tue May 9 21:45:56 PDT 2017: Detected CDH_VERSION of [5]
Tue May 9 21:45:56 PDT 2017: Starting Spark History Server
Running [/usr/lib/spark/bin/spark-class org.apache.spark.deploy.history.HistoryServer --properties-file /var/run/cloudera-scm-agent/process/18-spark_on_yarn-SPARK_YARN_HISTORY_SERVER/spark-conf/spark-history-server.conf]
Tue May 9 21:46:10 PDT 2017
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Using -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/spark_on_yarn_spark-SPARK_YARN_HISTORY_SERVER_pid29233.hprof -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh as CSD_JAVA_OPTS
Using /var/run/cloudera-scm-agent/process/18-spark_on_yarn-SPARK_YARN_HISTORY_SERVER as conf dir
Using scripts/control.sh as process script
CONF_DIR=/var/run/cloudera-scm-agent/process/18-spark_on_yarn-SPARK_YARN_HISTORY_SERVER
CMF_CONF_DIR=/etc/cloudera-scm-agent
Tue May 9 21:46:10 PDT 2017: Running Spark CSD control script...
Tue May 9 21:46:10 PDT 2017: Detected CDH_VERSION of [5]
Tue May 9 21:46:10 PDT 2017: Starting Spark History Server
Running [/usr/lib/spark/bin/spark-class org.apache.spark.deploy.history.HistoryServer --properties-file /var/run/cloudera-scm-agent/process/18-spark_on_yarn-SPARK_YARN_HISTORY_SERVER/spark-conf/spark-history-server.conf]

Announcements