Support Questions
Find answers, ask questions, and share your expertise

Spark History Server is Stopped because of the following exception in log file: SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[spark-history-task-0,5,main] java.lang.OutOfMemoryError: GC overhead limit exceeded.

Spark History Server is Stopped because of the following exception in log file: SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[spark-history-task-0,5,main] java.lang.OutOfMemoryError: GC overhead limit exceeded.

Contributor

can some one provide the best setting for spark heap size, much appricated

2 REPLIES 2

Re: Spark History Server is Stopped because of the following exception in log file: SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[spark-history-task-0,5,main] java.lang.OutOfMemoryError: GC overhead limit exceeded.

Explorer

@ANSARI FAHEEM AHMED , Can you try to see memory assigned to Spark History Server ? See if you can increase it. Second thought is please check no of applications is being shown in History server and see what is limit assigned to it. Hope this may help.

Regards,

Fahim

Re: Spark History Server is Stopped because of the following exception in log file: SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[spark-history-task-0,5,main] java.lang.OutOfMemoryError: GC overhead limit exceeded.

Cloudera Employee

Hi,

 

Please check for the Heap memory of the Spark history server. Based on the load size, the memory can be increased.

 

Thanks

AK