Created 12-23-2020 07:50 PM
I am running spark job which takes 6 hours.
1) How to monitor spark jobs running on which nodes?
2) How to diagnose failed spark jobs?
Created 12-28-2020 05:52 AM
@SPARK_LEARN Below doc can help you.
https://docs.cloudera.com/documentation/enterprise/5-9-x/topics/operation_spark_applications.html
https://spark.apache.org/docs/1.6.0/monitoring.html