Cloudera Community

Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search

How to monitor for failed spark job

Labels:
avatar
author-rank SPARK_LEARN
New Contributor

Created ‎12-23-2020 07:50 PM

I am running spark job which takes 6 hours.

1) How to monitor spark jobs running on which nodes?

2) How to diagnose failed spark jobs?

1,445 Views
0 Kudos
1 REPLY 1

avatar
author-rank GangWar author-rank
Master Guru

Created ‎12-28-2020 05:52 AM

@SPARK_LEARN Below doc can help you.

https://docs.cloudera.com/documentation/enterprise/5-9-x/topics/operation_spark_applications.html

https://spark.apache.org/docs/1.6.0/monitoring.html


Cheers!
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
1,422 Views
0 Kudos
Announcements
What's New @ Cloudera
Cloudera Data Engineering 1.23: Access Spark from Your Favor...
What's New @ Cloudera
HBase REST server scaling support is Generally Available
What's New @ Cloudera
New CLI option in the update-database command
What's New @ Cloudera
New Action menu item in the Cloudera Operational Database UI
What's New @ Cloudera
Get the list of supported instance types in the Cloudera Ope...
View More Announcements