Support Questions
Find answers, ask questions, and share your expertise

provide pyspark3 via livy

Explorer

As said in the following post https://hortonworks.com/blog/recent-improvements-apache-zeppelin-livy-integration/

User can use livy.pyspark3 for python3 with spark. Can anyone help me which all configuration need to be set for the same

1 ACCEPTED SOLUTION

Accepted Solutions

Re: provide pyspark3 via livy

@btandel @Saurabh,

Did you try setting "livy.spark.yarn.appMasterEnv.PYSPARK3_PYTHON" in the livy interperter setting.

Use %livy.python3 in your paragraph.

Thanks,

Aditya

View solution in original post

2 REPLIES 2

Re: provide pyspark3 via livy

Guru

Can someone tell what configuration need to be change to use pyspark3 ?

Re: provide pyspark3 via livy

@btandel @Saurabh,

Did you try setting "livy.spark.yarn.appMasterEnv.PYSPARK3_PYTHON" in the livy interperter setting.

Use %livy.python3 in your paragraph.

Thanks,

Aditya

View solution in original post