Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Missing Spark History

Missing Spark History

New Contributor

Hi,

 

I am using CDH5.5.2 in cluster mode. spark application run in yarn-cluster mode.

 

when checking spark history, i observed some completed jobs history is being stored and some completed jobs history is not being stored.

 

Can anyone help me know why this random behaviour occur.