Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

spark on cloudera quick start vm

spark on cloudera quick start vm

New Contributor

How to start spak in master yarn mode  not in local mode .

in cloudera quickstart vm 

4 REPLIES 4

Re: spark on cloudera quick start vm

Champion

Could you let me know if your trying to fire the job in python,scala or java ? 

 

 

spark-submit --class YourClassName  \
--master yarn --deploy-mode cluster --executor-memory 1g 
--conf

Re: spark on cloudera quick start vm

New Contributor
I am trying to read a file from hdfs using spark configuration object.
When I am running spark-shell it is running on local mode.please let me now
how to start in yarn mode.


Thanks & Regards
Surya

Re: spark on cloudera quick start vm

Master Collaborator
spark-shell --master yarn-client

Re: spark on cloudera quick start vm

Champion

did you try firing the above command let me know if that works ? 

Don't have an account?
Coming from Hortonworks? Activate your account here