question Re: Spark SQL Job stcuk indefinitely at last task of a stage -- Shows INFO: BlockManagerInfo : Removed broadcast in memory in Support Questions

question Re: Spark SQL Job stcuk indefinitely at last task of a stage -- Shows INFO: BlockManagerInfo : Removed broadcast in memory in Support Questions https://community.cloudera.com/t5/Support-Questions/Spark-SQL-Job-stcuk-indefinitely-at-last-task-of-a-stage/m-p/132546#M95216 why i asked this Question becuase I am runnign my job in client mode and I am not sure if below setting with client mode<PRE>ContextService.getHiveContext.sql("SET spark.yarn.executor.memoryOverhead = 3000 "); ContextService.getHiveContext.sql("SET spark.yarn.am.memoryOverhead = 3000");</PRE>spark.yarn.executor.memoryOverhead works in cluster mode...spark.yarm.am.memoryOverhead is Same as <CODE>spark.yarn.driver.memoryOverhead</CODE>, but for the YARN Application Master in client mode. Tue, 19 Jul 2016 17:00:15 GMT pkhare 2016-07-19T17:00:15Z