We have enabled jupyter notebook currently using the attached architecture illustration.
Installed Livy on Edge Node
Configured Jupyter Notebook on Developers node to communicate with Livy to submit spark jobs.
Enabled Impersonation to submit spark-jobs via proxy-user.
The setup works fine. But, we need to implement additional layer of security for SparkMagic -> Livy communication.
Does Livy support LDAP and Rest-API authenticaton?
Did anyone implemented security to Livy for Rest Client? If yes, can you guys share the details on configuring them for LDAP or HTTP-Basic Authentication?.
... View more