Reply
New Contributor
Posts: 1
Registered: ‎09-02-2017

How can i use python3.6.2 in pyspark in cloudera?????

I try to add export PYSPARK_PYTHON=/home/cloudera/Python-3.6.2 in spark-env.sh
Then i run pyspark, it show /home/cloudera/Python-3.6.2 permission denied.

Highlighted
Cloudera Employee
Posts: 39
Registered: ‎10-07-2016

Re: How can i use python3.6.2 in pyspark in cloudera?????

Howdy,

 

Thanks for reaching out. Inititally, it would seem there are some permission issues. I would start by checking the permissions for the directory the error mentions.

 

ls -lh /home/cloudera/Python-3.6.2

 

(the h is just a personal preference of mine)

 

Let me know what you get, and I can help from there if you'd like. 

 

Cheers,

Josh

Announcements