Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Issue with CDH5.2 with spark and yarn

Issue with CDH5.2 with spark and yarn

New Contributor

We are issues with CDH5.2  with spark and yarn -- Below is error. Looks like this is bug-

+ export COMMON_SCRIPT=/usr/lib64/cmf/service/common/cloudera-config.sh
+ COMMON_SCRIPT=/usr/lib64/cmf/service/common/cloudera-config.sh
+ chmod u+x /var/run/cloudera-scm-agent/process/76-spark_on_yarn-SPARK_YARN_HISTORY_SERVER-SparkUploadJarCommand/scripts/control.sh
+ exec /var/run/cloudera-scm-agent/process/76-spark_on_yarn-SPARK_YARN_HISTORY_SERVER-SparkUploadJarCommand/scripts/control.sh upload_jar
Wed Nov 12 13:45:05 GMT 2014
Wed Nov 12 13:45:05 GMT 2014: Detected CDH_VERSION of [5]
Wed Nov 12 13:45:05 GMT 2014: Uploading Spark assembly jar to '/user/spark/share/lib/spark-assembly.jar' on CDH 5 cluster
/var/run/cloudera-scm-agent/process/76-spark_on_yarn-SPARK_YARN_HISTORY_SERVER-SparkUploadJarCommand/scripts/control.sh: line 168: hdfs: command not found
/var/run/cloudera-scm-agent/process/76-spark_on_yarn-SPARK_YARN_HISTORY_SERVER-SparkUploadJarCommand/scripts/control.sh: line 174: hdfs: command not found
/var/run/cloudera-scm-agent/process/76-spark_on_yarn-SPARK_YARN_HISTORY_SERVER-SparkUploadJarCommand/scripts/control.sh: line 177: hdfs: command not found
Don't have an account?
Coming from Hortonworks? Activate your account here