Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Does Spark need Python 3 and dependencies on all cluster nodes to work with Python 3 ?

Does Spark need Python 3 and dependencies on all cluster nodes to work with Python 3 ?

Expert Contributor

Does Spark need Python 3 and dependencies on all cluster nodes to work with Python 3 ?

1 REPLY 1

Re: Does Spark need Python 3 and dependencies on all cluster nodes to work with Python 3 ?

New Contributor

I believe PySpark doesn't guarantee working with different Python versions. It should be the best to match and have the same Python with driver side.