Reply
Explorer
Posts: 16
Registered: ‎12-21-2017

How to view the log of submitted spark jar program?

[ Edited ]

I have submitted a spark java program via "Spark Submit Jar" and it looks running well.

However, when I click the logs link in specified application in Job tab in hue,  it shows "cannot acces: /jobbrowser/jobs/appliacation_****/single_logs."

 

So how can I find logs of running spark application? 

Highlighted
Champion
Posts: 744
Registered: ‎05-16-2016

Re: How to view the log of submitted spark jar program?

[ Edited ]

 

You can hit the below url for currently runining jobs for 

 http://spark_driver_host:4040

monitoring purpose 

 

To see the completed jobs you can see in Spark History Web UI 

 

Let me know if you need any more information. 

 

 

Reference 

https://www.cloudera.com/documentation/enterprise/5-9-x/topics/operation_spark_applications.html#con...

Announcements