Support Questions
Find answers, ask questions, and share your expertise

Missing Spark History

Missing Spark History

New Contributor

Hi,

 

I am using CDH5.5.2 in cluster mode. spark application run in yarn-cluster mode.

 

when checking spark history, i observed some completed jobs history is being stored and some completed jobs history is not being stored.

 

Can anyone help me know why this random behaviour occur.

Don't have an account?