question Is there any documentation on how livy enables sharing spark context? in Archives of Support Questions (Read Only)

Is there any documentation on how livy enables sharing spark context?

sunile_manjee — Sat, 17 Sep 2016 03:48:24 GMT

Is there any documentation on how livy enables sharing spark context? I would like to know more about sharing RDD or dataframe when using livy with spark.

Re: Is there any documentation on how livy enables sharing spark context?

ahadjidj — Sat, 17 Sep 2016 18:08:42 GMT

Hi @Sunile Manjee

Have you seen these?

Hadoop Summit presentation : https://www.youtube.com/watch?v=NtEyW27NkgA
http://gethue.com/how-to-use-the-livy-spark-rest-job-server-api-for-sharing-spark-rdds-and-contexts/

Re: Is there any documentation on how livy enables sharing spark context?

TimothySpann — Mon, 19 Sep 2016 03:18:09 GMT

https://developer.ibm.com/hadoop/2016/04/26/submit-spark-jobs-via-rest-iop-4-1-using-livy/

http://livy.io/overview.html

http://www.slideshare.net/JenAman/livy-a-rest-web-service-for-apache-spark

https://spark-summit.org/eu-2015/events/building-a-rest-job-server-for-interactive-spark-as-a-service/

Livy with Zeppelin http://www.slideshare.net/HadoopSummit/apache-zeppelin-livy-bringing-multi-tenancy-to-interactive-data-analysis https://github.com/apache/zeppelin/blob/master/docs/interpreter/livy.md Using Livy with Zeppelin https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_zeppelin-component-guide/content/ch_stop-services.html https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_zeppelin-component-guide/content/install-livy.html