Spark History Server is Stopped because of the following exception in log file: SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[spark-history-task-0,5,main] java.lang.OutOfMemoryError: GC overhead limit exceeded.

[#1]

can some one provide the best setting for spark heap size, much appricated

[#2]

@ANSARI FAHEEM AHMED , Can you try to see memory assigned to Spark History Server ? See if you can increase it. Second thought is please check no of applications is being shown in History server and see what is limit assigned to it. Hope this may help.

Regards,

Fahim

[#3]

Hi,

Please check for the Heap memory of the Spark history server. Based on the load size, the memory can be increased.

Thanks

AK