Support Questions

Find answers, ask questions, and share your expertise

Is sharing spark RDD or context a supported in HDP 2.5?

avatar
Master Guru

Is sharing spark RDD or context a supported in HDP 2.5 via livy server? Everything I see is via zeppelin interrupter to livy. I want to know if strictly using spark is sharing spark (not zeppelin) RDD or context supported.

1 ACCEPTED SOLUTION

avatar

@Sunile Manjee it is not supported by HDP 2.5 , confirmed that yesterday with @vshukla

View solution in original post

13 REPLIES 13

avatar

Livy is not "hidden". If you have started the Livy server, you can interact with its REST API from any application.

avatar
Super Guru

@Randy Gelhausen

Yes. With HDP 2.5. I missed that memo. Before that was "Installed as Spark Ambari Service, not yet exposed outside of Zeppelin". The following was needed: https://github.com/hortonworks-gallery/ambari-zeppelin-service

avatar
Master Guru

Just to close this out as i was able to get info required. Sharing RDD and context outside of zeppelin is not supported.

avatar
Super Guru

@Sunile Manjee

As I mentioned in my original response: Not without Livy. Yes with Livy (@vshukla). However, it is exposed only to Zeppelin, for now.