Created 09-22-2016 04:12 PM
Is sharing spark RDD or context a supported in HDP 2.5 via livy server? Everything I see is via zeppelin interrupter to livy. I want to know if strictly using spark is sharing spark (not zeppelin) RDD or context supported.
Created 09-22-2016 04:24 PM
@Sunile Manjee it is not supported by HDP 2.5 , confirmed that yesterday with @vshukla
Created 09-23-2016 08:34 PM
Livy is not "hidden". If you have started the Livy server, you can interact with its REST API from any application.
Created 09-24-2016 01:08 AM
Yes. With HDP 2.5. I missed that memo. Before that was "Installed as Spark Ambari Service, not yet exposed outside of Zeppelin". The following was needed: https://github.com/hortonworks-gallery/ambari-zeppelin-service
Created 10-31-2016 03:56 PM
Just to close this out as i was able to get info required. Sharing RDD and context outside of zeppelin is not supported.
Created 10-31-2016 04:09 PM
As I mentioned in my original response: Not without Livy. Yes with Livy (@vshukla). However, it is exposed only to Zeppelin, for now.