Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

How to run .R files using spark-submit from CDSW terminal?

How to run .R files using spark-submit from CDSW terminal?

Explorer

Hello Team,

 

Unable to run .R files from CDSW terminal .Getting error after running below code. Please let me know how to overcome from this.

 

!spark-submit -v --master yarn --deploy-mode client --num-executors 10 --executor-memory 4g --executor-cores 4 --driver- cores 4 --driver-memory 4g Sample.R

 

Thanks and Regards

Sankar Narayana

1 REPLY 1
Highlighted

Re: How to run .R files using spark-submit from CDSW terminal?

Rising Star

Hello @Sankar

 

Thanks for posting your query,

 

You can try launching R engine in your CDSW and try running your code.

 

Also, could you please share us what was the error which you are receiving while launching the job and how you are running the job ?

 

Thanks,
Satz