question Re: HDP 2.3.4 - spark web UI in Archives of Support Questions (Read Only)

HDP 2.3.4 - spark web UI

sandeep_mehta1 — Sun, 24 Jan 2016 04:41:26 GMT

In ambari, i can only see link for Spark History server UI. what is the URL for opening Spark Web UI to debug Spark DAG?

I am running HDP 2.3.4 with Spark 1.5.2

Re: HDP 2.3.4 - spark web UI

jgeorge — Sun, 24 Jan 2016 04:52:07 GMT

Hi,

Say If you are running spark-shell, pyspark, spark-sql from sandbox locally, you can try accessing http://sandbox:4040 to see the UI [only while application is running]. Spark launches UI starting from 4040 by default and if u run another local instances parallel to it will go 4041, 4042 etc.

Thanks,

Jobin George

Re: HDP 2.3.4 - spark web UI

gbraccialli3 — Tue, 16 Feb 2016 09:56:47 GMT

@Sandeep

If you open YARN UI and click Application Master link, you will be redirect to Spark Web UI of your application submitted by spark-shell (and others).