Created 04-04-2018 03:13 AM
Does Spark need Python 3 and dependencies on all cluster nodes to work with Python 3 ?
Created 04-04-2018 05:38 AM
I believe PySpark doesn't guarantee working with different Python versions. It should be the best to match and have the same Python with driver side.