Support Questions

Find answers, ask questions, and share your expertise
Announcements
Welcome to the upgraded Community! Read this blog to see What’s New!

Permission denied submitting Spark as "spark" user

avatar
Explorer

When I submit a Spark program like this, after su Spark, I get a "bash: ./bin/spark-submit: Permission denied" error.

What is the password for "spark" user? How can I cross thi step? Please help.

[spark@sandbox root]$ ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client --num-executors 3 --driver-memory 512m --executor-memory 512m --executor-cores 1 examples/jars/spark-examples*.jar 10

1 ACCEPTED SOLUTION

avatar
Explorer

I was able to find the issue. I had not gone to the correct folder location "" before running the spark-submit. Before running "spark-submit" we should navigate to the right folder "$cd /usr/hdp/current/spark-client".

View solution in original post

1 REPLY 1

avatar
Explorer

I was able to find the issue. I had not gone to the correct folder location "" before running the spark-submit. Before running "spark-submit" we should navigate to the right folder "$cd /usr/hdp/current/spark-client".

Labels