We are using CDH 5.8.3 community version and we want to add support for Python 3.5+ to our cluster since our research algos need Python 3.5+ in order to run their spark jobs successfully.
I know that Cloudera and Anaconda has such parcel to support Python, but this parcel support Python version 2.7.
What is the recommended way to enable Python version 3+ on CDH cluster?
Thanks for the link you shared but again the Anaconda parcel only comes with Python 2.7 and I need Python 3.5.
So if I want to enable Python 3.5 in the cluster what are the best recommanded methods?
What if I want to enable multiple Python versions in the cluster and enable each app to run with its own Python version?
Continuum ships Anaconda parcel and Cloudera does not have control on which python version it installs.
Please use the OS package management tool to install python 3.5 on the servers in the CDH cluster, once that is done, please follow this doc to set python for your pyspark job:
Can you give some steps and instructions to install Python3.5 or Anaconda package in the CDH cluster? By using the parcel way is not working as expected, the parcel shows the message, distributed, activated, but it is not with python3.5, it is still using python2.7. Please let me know if there is any document to install manually anaconda with python3.5 to cdh cluster through the command line.