https://community.cloudera.com/t5/Support-Questions/spark-yarn-client-mode-failed-due-to-OutOfMemoryError/m-p/110877#M73725 <P>Halting due to Out Of Memory Error ...</P><PRE> Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "dispatcher-event-loop-0" Halting due to Out Of Memory Error ... Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "IPC Client (724929395) connection to /172.22.103.121:39927 from job_1471597554341_0133" Halting due to Out Of Memory Error ... Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "main" Halting due to Out Of Memory Error ... Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "LeaseRenewer:hrt_qa@nat-r7-movs-oozie-1-5.openstacklocal:8020" Halting due to Out Of Memory Error ... Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "shuffle-server-0" End of LogType:stderr </PRE> Fri, 17 Feb 2017 08:11:21 GMT zhe 2017-02-17T08:11:21Z https://community.cloudera.com/t5/Support-Questions/spark-yarn-client-mode-failed-due-to-OutOfMemoryError/m-p/110877#M73725 <P>Halting due to Out Of Memory Error ...</P><PRE> Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "dispatcher-event-loop-0" Halting due to Out Of Memory Error ... Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "IPC Client (724929395) connection to /172.22.103.121:39927 from job_1471597554341_0133" Halting due to Out Of Memory Error ... Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "main" Halting due to Out Of Memory Error ... Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "LeaseRenewer:hrt_qa@nat-r7-movs-oozie-1-5.openstacklocal:8020" Halting due to Out Of Memory Error ... Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "shuffle-server-0" End of LogType:stderr </PRE> Fri, 17 Feb 2017 08:11:21 GMT https://community.cloudera.com/t5/Support-Questions/spark-yarn-client-mode-failed-due-to-OutOfMemoryError/m-p/110877#M73725 zhe 2017-02-17T08:11:21Z https://community.cloudera.com/t5/Support-Questions/spark-yarn-client-mode-failed-due-to-OutOfMemoryError/m-p/110878#M73726 <P>You can probably increase AM memory in "spark.yarn.am.memory", see if it helps. Default is 512m, start with 2g or 4g.</P> Fri, 17 Feb 2017 08:23:09 GMT https://community.cloudera.com/t5/Support-Questions/spark-yarn-client-mode-failed-due-to-OutOfMemoryError/m-p/110878#M73726 vjiang 2017-02-17T08:23:09Z https://community.cloudera.com/t5/Support-Questions/spark-yarn-client-mode-failed-due-to-OutOfMemoryError/m-p/110879#M73727 <P>You can try to give --driver-memory to 2g in spark-submit command and see if it helps</P> Fri, 17 Feb 2017 08:32:49 GMT https://community.cloudera.com/t5/Support-Questions/spark-yarn-client-mode-failed-due-to-OutOfMemoryError/m-p/110879#M73727 trupti 2017-02-17T08:32:49Z