Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark Submit fails - /opt/cloudera/parcels/CDH/bin/spark-class: No such file or directory

Highlighted

Spark Submit fails - /opt/cloudera/parcels/CDH/bin/spark-class: No such file or directory

I'm doing following Tutorial and doing "4. Submit the application using spark-submit". Why this simple scenario fails? I find spark-shell and spark-submit, but not Spark-slass from bin.

 

https://www.cloudera.com/documentation/enterprise/5-5-x/topics/spark_streaming.html#streaming

 

export SPARK_HOME="/opt/cloudera/parcels/CDH"

 

spark-submit --master local[2] --conf "spark.dynamicAllocation.enabled=false" --jars $SPARK_HOME/lib/spark/lib/spark-examples.jar kafka_wordcount_ken.py k localhost:2181 POCTopicKen1

 

[Myadmin@Myclouderadatahub-mn0 lib]$ spark-submit --master local[2]  --jars $SPARK_HOME/lib/spark/lib/spark-examples.jar kafka_wordcount_ken.py localhost:2181 POCTopicKen1

/log/cloudera/parcels/CDH-5.12.1-1.cdh5.12.1.p0.3/bin/../lib/spark/bin/spark-submit: line 27: /opt/cloudera/parcels/CDH/bin/spark-class: No such file or directory

/log/cloudera/parcels/CDH-5.12.1-1.cdh5.12.1.p0.3/bin/../lib/spark/bin/spark-submit: line 27: exec: /opt/cloudera/parcels/CDH/bin/spark-class: cannot execute: No such file or directory

[Myadmin@Myclouderadatahub-mn0 lib]$

Don't have an account?
Coming from Hortonworks? Activate your account here