Spark 1.6 with Zeppelin

[#1]

Hi,

Is there any Zeppelin Tech Preview which is made to work with Spark 1.6 on HDP? I have setup Zeppelin 0.6.0 with Spark 1.6 But looks its not yet supported.

Thanks

Vijay

[#2]

@vbhoomireddy please follow this tutorial http://hortonworks.com/hadoop-tutorial/apache-spark-1-6-technical-preview-with-hdp-2-3/

Link and Link for zepplin

[#3]

@vshukla

[#4]

Artem,

I have setup both Spark and Zeppelin following the above links. However, when I create a zeppelin notebook and run sc.version, I get a 'Spark 1.6 is not supprted message'. So wondering whether there is any other alternative to get this working. Please see the below screenshot. Thanks

[#5]

@vbhoomireddy both zepplin and Spark 1.6 are technical preview so yes we do not officially support it until its stable very soon.

[#6 · Accepted solution]

Zeppelin ships with Spark embedded with it. If you follow the Zeppelin tech preview you can get it to work with Spark 1.5.x in HDP 2.3.4.

In Apache, Zeppelin released a version compatible with Spark 1.6 on Jan 22nd. You can get the binary of that Zeppelin from https://zeppelin.incubator.apache.org/download.html and follow the Zeppelin TP http://hortonworks.com/hadoop-tutorial/apache-zeppelin/ to get it work with Spark 1.6 Tech Preview (http://hortonworks.com/hadoop-tutorial/apache-spark-1-6-technical-preview-with-hdp-2-3/)

[#7]

Thanks @vshukla Timely news! Got it working now. Kind regards