Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

run pyspark2 in yarn-cluster mode

Highlighted

run pyspark2 in yarn-cluster mode

Expert Contributor

I've a pyspark2 application on the CDSW, it is executed correctly but the default seems to be yarn-client mode. 

I need to execute it in yarn-cluster mode, how can it be done on the CDSW?

 

Thanks for any info