question Re: Spark 1.6 with Zeppelin in Archives of Support Questions (Read Only)

Spark 1.6 with Zeppelin

vbhoomireddy — Thu, 28 Jan 2016 23:49:32 GMT

Hi,

Is there any Zeppelin Tech Preview which is made to work with Spark 1.6 on HDP? I have setup Zeppelin 0.6.0 with Spark 1.6 But looks its not yet supported.

Thanks

Vijay

Re: Spark 1.6 with Zeppelin

aervits — Thu, 28 Jan 2016 23:56:18 GMT

@vbhoomireddy please follow this tutorial http://hortonworks.com/hadoop-tutorial/apache-spark-1-6-technical-preview-with-hdp-2-3/

Link and Link for zepplin

Re: Spark 1.6 with Zeppelin

nsabharwal — Thu, 28 Jan 2016 23:56:24 GMT

@vshukla

Re: Spark 1.6 with Zeppelin

vbhoomireddy — Mon, 19 Aug 2019 10:56:41 GMT

Artem,

I have setup both Spark and Zeppelin following the above links. However, when I create a zeppelin notebook and run sc.version, I get a 'Spark 1.6 is not supprted message'. So wondering whether there is any other alternative to get this working. Please see the below screenshot. Thanks

Re: Spark 1.6 with Zeppelin

aervits — Fri, 29 Jan 2016 02:29:23 GMT

@vbhoomireddy both zepplin and Spark 1.6 are technical preview so yes we do not officially support it until its stable very soon.

Re: Spark 1.6 with Zeppelin

vshukla — Sat, 30 Jan 2016 03:59:06 GMT

Zeppelin ships with Spark embedded with it. If you follow the Zeppelin tech preview you can get it to work with Spark 1.5.x in HDP 2.3.4.

In Apache, Zeppelin released a version compatible with Spark 1.6 on Jan 22nd. You can get the binary of that Zeppelin from https://zeppelin.incubator.apache.org/download.html and follow the Zeppelin TP http://hortonworks.com/hadoop-tutorial/apache-zeppelin/ to get it work with Spark 1.6 Tech Preview (http://hortonworks.com/hadoop-tutorial/apache-spark-1-6-technical-preview-with-hdp-2-3/)

Re: Spark 1.6 with Zeppelin

vbhoomireddy — Sat, 30 Jan 2016 05:32:20 GMT

Thanks @vshukla Timely news! Got it working now. Kind regards