Support Questions
Find answers, ask questions, and share your expertise

Permission denied submitting Spark as "spark" user

Explorer

When I submit a Spark program like this, after su Spark, I get a "bash: ./bin/spark-submit: Permission denied" error.

What is the password for "spark" user? How can I cross thi step? Please help.

[spark@sandbox root]$ ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client --num-executors 3 --driver-memory 512m --executor-memory 512m --executor-cores 1 examples/jars/spark-examples*.jar 10

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Permission denied submitting Spark as "spark" user

Explorer

I was able to find the issue. I had not gone to the correct folder location "" before running the spark-submit. Before running "spark-submit" we should navigate to the right folder "$cd /usr/hdp/current/spark-client".

View solution in original post

1 REPLY 1

Re: Permission denied submitting Spark as "spark" user

Explorer

I was able to find the issue. I had not gone to the correct folder location "" before running the spark-submit. Before running "spark-submit" we should navigate to the right folder "$cd /usr/hdp/current/spark-client".

View solution in original post