I'm working on HDP 2.5 SandBox Microsoft Azure, I'm analysing different notebook framework and how they could be adapted to our infrastructure. I'm working now with Jupyter and trying to connect it to Spark cluster.
I want to separate gateway from Hadoop worker. List the various options like " Livy " . I would like in particular to get some ideas on the latency introduced by the mechanism.