question Is there a Spark Notebook which is easily installable on HDP? in Archives of Support Questions (Read Only)

Is there a Spark Notebook which is easily installable on HDP?

alexmc — Thu, 07 Jan 2016 19:34:56 GMT

I've been trying to figure out what is the best/most appropriate Spark Notebook (web based IDE) for use on an HDP cluster.

Is there one available through Hortonworks packages?

I have found a number of training lessons from Hortonworks which talk about installing iPython Notebook (which can work for python+spark as well as scala+spark). However they seem to assume you are on a sandbox and are compiling and installing the software they demand, not checking what is already there and not using packages.

I have also seen mentions of Zeppelin - an Apache incubating project. This is good too - but I have the same problem - I have to build it myself and it doesn't for me.

There are also third party Notebooks such as the Cloud based one from Data Bricks.

Any recommendations? What has worked for you?

Re: Is there a Spark Notebook which is easily installable on HDP?

SQLShaw — Thu, 07 Jan 2016 20:48:42 GMT

We recommend Zeppelin. Apache Zeppelin is currently in tech preview and is included in the most recent sandbox. Otherwise, you can walk through the install here: http://hortonworks.com/hadoop/zeppelin/#section_3

Look for Zeppelin to be included out-of-the-box in future HDP releases.

Re: Is there a Spark Notebook which is easily installable on HDP?

alexmc — Thu, 07 Jan 2016 22:27:55 GMT

Thanks!

Sounds like my sandbox is out of date now 🙂