Support Questions
Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Does Spark need Python 3 and dependencies on all cluster nodes to work with Python 3 ?

Highlighted

Does Spark need Python 3 and dependencies on all cluster nodes to work with Python 3 ?

nyakkanti
Expert Contributor

Created ‎04-04-2018 03:13 AM

Does Spark need Python 3 and dependencies on all cluster nodes to work with Python 3 ?

Reply
116 Views
0 Kudos
1 REPLY 1

Re: Does Spark need Python 3 and dependencies on all cluster nodes to work with Python 3 ?

hkwon
New Contributor

Created ‎04-04-2018 05:38 AM

I believe PySpark doesn't guarantee working with different Python versions. It should be the best to match and have the same Python with driver side.

Reply
12 Views
0 Kudos
Don't have an account?
Register
Coming from Hortonworks? Activate your account here