Hi,

I am using CDH5.5.2 in cluster mode. spark application run in yarn-cluster mode.

when checking spark history, i observed some completed jobs history is being stored and some completed jobs history is not being stored.

Can anyone help me know why this random behaviour occur.