Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Spark History Server is Stopped because of the following exception in log file: SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[spark-history-task-0,5,main] java.lang.OutOfMemoryError: GC overhead limit exceeded.

avatar
Rising Star

can some one provide the best setting for spark heap size, much appricated

2 REPLIES 2

avatar
Explorer

@ANSARI FAHEEM AHMED , Can you try to see memory assigned to Spark History Server ? See if you can increase it. Second thought is please check no of applications is being shown in History server and see what is limit assigned to it. Hope this may help.

Regards,

Fahim

avatar
Cloudera Employee

Hi,

 

Please check for the Heap memory of the Spark history server. Based on the load size, the memory can be increased.

 

Thanks

AK