Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

provide pyspark3 via livy

Solved Go to solution

provide pyspark3 via livy

New Contributor

As said in the following post https://hortonworks.com/blog/recent-improvements-apache-zeppelin-livy-integration/

User can use livy.pyspark3 for python3 with spark. Can anyone help me which all configuration need to be set for the same

1 ACCEPTED SOLUTION

Accepted Solutions

Re: provide pyspark3 via livy

@btandel @Saurabh,

Did you try setting "livy.spark.yarn.appMasterEnv.PYSPARK3_PYTHON" in the livy interperter setting.

Use %livy.python3 in your paragraph.

Thanks,

Aditya

2 REPLIES 2

Re: provide pyspark3 via livy

Guru

Can someone tell what configuration need to be change to use pyspark3 ?

Re: provide pyspark3 via livy

@btandel @Saurabh,

Did you try setting "livy.spark.yarn.appMasterEnv.PYSPARK3_PYTHON" in the livy interperter setting.

Use %livy.python3 in your paragraph.

Thanks,

Aditya

Don't have an account?
Coming from Hortonworks? Activate your account here