Spark 2 and Zeppelin

[#1]

Hi,

I was wondering if anyone tried setting up Zeppelin to work with Spark2 on HDP 2.5? As far as I understand, I can switch Spark version via SPARK_MAJOR_VERSION variable, and it works for spark-submit, but Zeppelin is still using Spark1.

Ideally, I want to have two different interpreter groups for every major Spark version, but just just switching it to Spark2 will be a good start. Any ideas?

[#2]

There is a related defect https://issues.apache.org/jira/browse/ZEPPELIN-1390 which has fix version as 0.6.1 and 0.7.0

[#3]

@vshukla Has this been backported into 0.6.0 which is version of zeppelin in hdp 2.5?

[#4 · Accepted solution]

Zeppelin in HDP 2.5 does not support Spark 2. A technical preview of this will land in Hortonworks Data Cloud in next month or so.