Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to run .R files using spark-submit from CDSW terminal?

Highlighted

How to run .R files using spark-submit from CDSW terminal?

Explorer

Hello Team,

 

Unable to run .R files from CDSW terminal .Getting error after running below code. Please let me know how to overcome from this.

 

!spark-submit -v --master yarn --deploy-mode client --num-executors 10 --executor-memory 4g --executor-cores 4 --driver- cores 4 --driver-memory 4g Sample.R

 

Thanks and Regards

Sankar Narayana

1 REPLY 1

Re: How to run .R files using spark-submit from CDSW terminal?

Rising Star

Hello @Sankar

 

Thanks for posting your query,

 

You can try launching R engine in your CDSW and try running your code.

 

Also, could you please share us what was the error which you are receiving while launching the job and how you are running the job ?

 

Thanks,
Satz
Don't have an account?
Coming from Hortonworks? Activate your account here