Created 12-05-2016 06:02 AM
When I submit a Spark program like this, after su Spark, I get a "bash: ./bin/spark-submit: Permission denied" error.
What is the password for "spark" user? How can I cross thi step? Please help.
[spark@sandbox root]$ ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client --num-executors 3 --driver-memory 512m --executor-memory 512m --executor-cores 1 examples/jars/spark-examples*.jar 10
Created 12-05-2016 06:18 AM
I was able to find the issue. I had not gone to the correct folder location "" before running the spark-submit. Before running "spark-submit" we should navigate to the right folder "$cd /usr/hdp/current/spark-client".
Created 12-05-2016 06:18 AM
I was able to find the issue. I had not gone to the correct folder location "" before running the spark-submit. Before running "spark-submit" we should navigate to the right folder "$cd /usr/hdp/current/spark-client".