Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

How does the Livy server for Zeppelin communicate with the Spark server?

avatar
New Contributor

Does it act like a Spark client and communicate over the normal Spark port numbers or is it all REST?

Which ports need to be opened in the firewall in the following flow?

Zeppelin <-> Livy Client <-> Livy Server <-> |-Firewall-| <-> Spark Cluster

1 ACCEPTED SOLUTION

avatar
Super Collaborator
3 REPLIES 3

avatar
Super Guru

Hi @Michael Gregory

Livy is a Rest server that acts as a Spark client. So you need to open nothing more than normal spark ports, listed here.

I would very highly recommend going over slide 14-31 on this link. These are just images so it should be easy and simple to go over this but it will give you a better understanding of Livy and will give you confidence in what you are trying to do.

avatar
Super Collaborator

There's a nice overview video from the June Hadoop Summit at

https://www.youtube.com/watch?v=gtql7z_kj3Y&list=PLKnYDs_-dq16K1NH83Bke2dGGUO3YKZ5b&index=114

avatar
Super Collaborator