HDP 2.3.4 - spark web UI

[#1]

In ambari, i can only see link for Spark History server UI. what is the URL for opening Spark Web UI to debug Spark DAG?

I am running HDP 2.3.4 with Spark 1.5.2

[#2 · Accepted solution]

Hi,

Say If you are running spark-shell, pyspark, spark-sql from sandbox locally, you can try accessing http://sandbox:4040 to see the UI [only while application is running]. Spark launches UI starting from 4040 by default and if u run another local instances parallel to it will go 4041, 4042 etc.

Thanks,

Jobin George

[#3]

@Sandeep

If you open YARN UI and click Application Master link, you will be redirect to Spark Web UI of your application submitted by spark-shell (and others).