Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Cloudera quick start VM

Highlighted

Cloudera quick start VM

New Contributor

I recently downloaded cloudera quick start VM 10.When ever I start Spark services using Cloudera Manager it throws me below exception, is there a way to resolve it.

 

Tue May 9 21:45:56 PDT 2017
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Using -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/spark_on_yarn_spark-SPARK_YARN_HISTORY_SERVER_pid25402.hprof -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh as CSD_JAVA_OPTS
Using /var/run/cloudera-scm-agent/process/18-spark_on_yarn-SPARK_YARN_HISTORY_SERVER as conf dir
Using scripts/control.sh as process script
CONF_DIR=/var/run/cloudera-scm-agent/process/18-spark_on_yarn-SPARK_YARN_HISTORY_SERVER
CMF_CONF_DIR=/etc/cloudera-scm-agent
Tue May 9 21:45:56 PDT 2017: Running Spark CSD control script...
Tue May 9 21:45:56 PDT 2017: Detected CDH_VERSION of [5]
Tue May 9 21:45:56 PDT 2017: Starting Spark History Server
Running [/usr/lib/spark/bin/spark-class org.apache.spark.deploy.history.HistoryServer --properties-file /var/run/cloudera-scm-agent/process/18-spark_on_yarn-SPARK_YARN_HISTORY_SERVER/spark-conf/spark-history-server.conf]
Tue May 9 21:46:10 PDT 2017
JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
Using -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/spark_on_yarn_spark-SPARK_YARN_HISTORY_SERVER_pid29233.hprof -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh as CSD_JAVA_OPTS
Using /var/run/cloudera-scm-agent/process/18-spark_on_yarn-SPARK_YARN_HISTORY_SERVER as conf dir
Using scripts/control.sh as process script
CONF_DIR=/var/run/cloudera-scm-agent/process/18-spark_on_yarn-SPARK_YARN_HISTORY_SERVER
CMF_CONF_DIR=/etc/cloudera-scm-agent
Tue May 9 21:46:10 PDT 2017: Running Spark CSD control script...
Tue May 9 21:46:10 PDT 2017: Detected CDH_VERSION of [5]
Tue May 9 21:46:10 PDT 2017: Starting Spark History Server
Running [/usr/lib/spark/bin/spark-class org.apache.spark.deploy.history.HistoryServer --properties-file /var/run/cloudera-scm-agent/process/18-spark_on_yarn-SPARK_YARN_HISTORY_SERVER/spark-conf/spark-history-server.conf]

Don't have an account?
Coming from Hortonworks? Activate your account here