Support Questions
Find answers, ask questions, and share your expertise

how to connect pyspark client to remote yarn cluster to execute pyspark job

how to connect pyspark client to remote yarn cluster to execute pyspark job

Contributor

Hello everyone, i am want to execute my pyspark on my subline(windows machine) by connecting to yarn cluster running on different machine. Does anyone have steps how to configure that and run it from inside sublime ?

(machine 1) MyMachine(pyspark) ======> (5 machine)YARN -CLUSTER