Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How can i use python3.6.2 in pyspark in cloudera?????

How can i use python3.6.2 in pyspark in cloudera?????

New Contributor

I try to add export PYSPARK_PYTHON=/home/cloudera/Python-3.6.2 in spark-env.sh
Then i run pyspark, it show /home/cloudera/Python-3.6.2 permission denied.

1 REPLY 1
Highlighted

Re: How can i use python3.6.2 in pyspark in cloudera?????

Rising Star

Howdy,

 

Thanks for reaching out. Inititally, it would seem there are some permission issues. I would start by checking the permissions for the directory the error mentions.

 

ls -lh /home/cloudera/Python-3.6.2

 

(the h is just a personal preference of mine)

 

Let me know what you get, and I can help from there if you'd like. 

 

Cheers,

Josh