Reply
Explorer
Posts: 7
Registered: ‎01-23-2019

How to run .R files using spark-submit from CDSW terminal?

Hello Team,

 

Unable to run .R files from CDSW terminal .Getting error after running below code. Please let me know how to overcome from this.

 

!spark-submit -v --master yarn --deploy-mode client --num-executors 10 --executor-memory 4g --executor-cores 4 --driver- cores 4 --driver-memory 4g Sample.R

 

Thanks and Regards

Sankar Narayana

Posts: 57
Topics: 0
Kudos: 8
Solutions: 5
Registered: ‎05-15-2018

Re: How to run .R files using spark-submit from CDSW terminal?

Hello @Sankar

 

Thanks for posting your query,

 

You can try launching R engine in your CDSW and try running your code.

 

Also, could you please share us what was the error which you are receiving while launching the job and how you are running the job ?

 

Thanks,
Satz