Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HDP 2.3.4 - spark web UI

Solved Go to solution
Highlighted

HDP 2.3.4 - spark web UI

New Contributor

In ambari, i can only see link for Spark History server UI. what is the URL for opening Spark Web UI to debug Spark DAG?

I am running HDP 2.3.4 with Spark 1.5.2

1 ACCEPTED SOLUTION

Accepted Solutions

Re: HDP 2.3.4 - spark web UI

Hi,

Say If you are running spark-shell, pyspark, spark-sql from sandbox locally, you can try accessing http://sandbox:4040 to see the UI [only while application is running]. Spark launches UI starting from 4040 by default and if u run another local instances parallel to it will go 4041, 4042 etc.

Thanks,

Jobin George

2 REPLIES 2

Re: HDP 2.3.4 - spark web UI

Hi,

Say If you are running spark-shell, pyspark, spark-sql from sandbox locally, you can try accessing http://sandbox:4040 to see the UI [only while application is running]. Spark launches UI starting from 4040 by default and if u run another local instances parallel to it will go 4041, 4042 etc.

Thanks,

Jobin George

Re: HDP 2.3.4 - spark web UI

@Sandeep

If you open YARN UI and click Application Master link, you will be redirect to Spark Web UI of your application submitted by spark-shell (and others).

Don't have an account?
Coming from Hortonworks? Activate your account here