Support Questions
Find answers, ask questions, and share your expertise

Does Spark need Python 3 and dependencies on all cluster nodes to work with Python 3 ?

Does Spark need Python 3 and dependencies on all cluster nodes to work with Python 3 ?

Expert Contributor

Does Spark need Python 3 and dependencies on all cluster nodes to work with Python 3 ?

1 REPLY 1
Highlighted

Re: Does Spark need Python 3 and dependencies on all cluster nodes to work with Python 3 ?

New Contributor

I believe PySpark doesn't guarantee working with different Python versions. It should be the best to match and have the same Python with driver side.