Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Permission denied submitting Spark as "spark" user

Solved Go to solution

Permission denied submitting Spark as "spark" user

Explorer

When I submit a Spark program like this, after su Spark, I get a "bash: ./bin/spark-submit: Permission denied" error.

What is the password for "spark" user? How can I cross thi step? Please help.

[spark@sandbox root]$ ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client --num-executors 3 --driver-memory 512m --executor-memory 512m --executor-cores 1 examples/jars/spark-examples*.jar 10

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Permission denied submitting Spark as "spark" user

Explorer

I was able to find the issue. I had not gone to the correct folder location "" before running the spark-submit. Before running "spark-submit" we should navigate to the right folder "$cd /usr/hdp/current/spark-client".

View solution in original post

1 REPLY 1
Highlighted

Re: Permission denied submitting Spark as "spark" user

Explorer

I was able to find the issue. I had not gone to the correct folder location "" before running the spark-submit. Before running "spark-submit" we should navigate to the right folder "$cd /usr/hdp/current/spark-client".

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here