Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Missing Spark History

Highlighted

Missing Spark History

New Contributor

Hi,

 

I am using CDH5.5.2 in cluster mode. spark application run in yarn-cluster mode.

 

when checking spark history, i observed some completed jobs history is being stored and some completed jobs history is not being stored.

 

Can anyone help me know why this random behaviour occur.