How Install and set anaconda instead of built-in python at HDP2.5 sandbox for Spark MLlib?

[#1]

I now use the sandbox at Windows 10 VirtualBox.

[#2 · Accepted solution]

You can install anaconda but will need to set the correct path during job execution

PYSPARK_PYTHON=/opt/anaconda/bin/python spark-submit spark-job.py

[#3]

thanks for replies.

could I do it like followings? export PYSPARK_PYTHON=/opt/anaconda/bin/python spark-submit spark-job.py

[#4]

Need to set new Python location via env variable PYSPARK_PYTHON