Reply
Highlighted
Expert Contributor
Posts: 70
Registered: ‎11-24-2017

run pyspark2 in yarn-cluster mode

[ Edited ]

I've a pyspark2 application on the CDSW, it is executed correctly but the default seems to be yarn-client mode. 

I need to execute it in yarn-cluster mode, how can it be done on the CDSW?

 

Thanks for any info

Announcements