Reply
Highlighted
Explorer
Posts: 11
Registered: ‎10-06-2017

Spark Submit fails - /opt/cloudera/parcels/CDH/bin/spark-class: No such file or directory

I'm doing following Tutorial and doing "4. Submit the application using spark-submit". Why this simple scenario fails? I find spark-shell and spark-submit, but not Spark-slass from bin.

 

https://www.cloudera.com/documentation/enterprise/5-5-x/topics/spark_streaming.html#streaming

 

export SPARK_HOME="/opt/cloudera/parcels/CDH"

 

spark-submit --master local[2] --conf "spark.dynamicAllocation.enabled=false" --jars $SPARK_HOME/lib/spark/lib/spark-examples.jar kafka_wordcount_ken.py k localhost:2181 POCTopicKen1

 

[Myadmin@Myclouderadatahub-mn0 lib]$ spark-submit --master local[2]  --jars $SPARK_HOME/lib/spark/lib/spark-examples.jar kafka_wordcount_ken.py localhost:2181 POCTopicKen1

/log/cloudera/parcels/CDH-5.12.1-1.cdh5.12.1.p0.3/bin/../lib/spark/bin/spark-submit: line 27: /opt/cloudera/parcels/CDH/bin/spark-class: No such file or directory

/log/cloudera/parcels/CDH-5.12.1-1.cdh5.12.1.p0.3/bin/../lib/spark/bin/spark-submit: line 27: exec: /opt/cloudera/parcels/CDH/bin/spark-class: cannot execute: No such file or directory

[Myadmin@Myclouderadatahub-mn0 lib]$

Announcements