Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Permission denied submitting Spark as "spark" user

Solved Go to solution

Permission denied submitting Spark as "spark" user

New Contributor

When I submit a Spark program like this, after su Spark, I get a "bash: ./bin/spark-submit: Permission denied" error.

What is the password for "spark" user? How can I cross thi step? Please help.

[spark@sandbox root]$ ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client --num-executors 3 --driver-memory 512m --executor-memory 512m --executor-cores 1 examples/jars/spark-examples*.jar 10

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Permission denied submitting Spark as "spark" user

New Contributor

I was able to find the issue. I had not gone to the correct folder location "" before running the spark-submit. Before running "spark-submit" we should navigate to the right folder "$cd /usr/hdp/current/spark-client".

1 REPLY 1

Re: Permission denied submitting Spark as "spark" user

New Contributor

I was able to find the issue. I had not gone to the correct folder location "" before running the spark-submit. Before running "spark-submit" we should navigate to the right folder "$cd /usr/hdp/current/spark-client".