Reply
New Contributor
Posts: 2
Registered: ‎02-11-2016

Missing Spark History

Hi,

 

I am using CDH5.5.2 in cluster mode. spark application run in yarn-cluster mode.

 

when checking spark history, i observed some completed jobs history is being stored and some completed jobs history is not being stored.

 

Can anyone help me know why this random behaviour occur.