Is there any documentation on how livy enables sharing spark context?

[#1]

Is there any documentation on how livy enables sharing spark context? I would like to know more about sharing RDD or dataframe when using livy with spark.

[#2 · Accepted solution]

Hi @Sunile Manjee

Have you seen these?

• Hadoop Summit presentation : https://www.youtube.com/watch?v=NtEyW27NkgA
• http://gethue.com/how-to-use-the-livy-spark-rest-job-server-api-for-sharing-spark-rdds-and-contexts/

[#3]

https://developer.ibm.com/hadoop/2016/04/26/submit-spark-jobs-via-rest-iop-4-1-using-livy/

http://livy.io/overview.html

http://www.slideshare.net/JenAman/livy-a-rest-web-service-for-apache-spark

https://spark-summit.org/eu-2015/events/building-a-rest-job-server-for-interactive-spark-as-a-servic...

Livy with Zeppelin http://www.slideshare.net/HadoopSummit/apache-zeppelin-livy-bringing-multi-tenancy-to-interactive-da... https://github.com/apache/zeppelin/blob/master/docs/interpreter/livy.md Using Livy with Zeppelin https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_zeppelin-component-guide/content/ch_stop... https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_zeppelin-component-guide/content/install...