Support Questions

Find answers, ask questions, and share your expertise

Spark submit fails, logs attached, ERROR CoarseGrainedExecutorBackend: Executor self-exiting due disassociated! Shutting down.

avatar
Rising Star

approx 30% of the jobs i submit fails, here are the logs with the error

19/03/04 18:43:17 ERROR CoarseGrainedExecutorBackend: Executor self-exiting due to : Driver grid-05.test.com:36315 disassociated! Shutting down. 19/03/04 18:43:17 INFO DiskBlockManager: Shutdown hook called 19/03/04 18:43:17 INFO ShutdownHookManager: Shutdown hook called


any idea how i can resolve it ?

3 REPLIES 3

avatar
Rising Star
Can anyone give idea to fix it ?

avatar
Cloudera Employee

Hi,

 

Could you please share the Entire application logs to analyse further?

 

Thanks

AKR

avatar
Super Guru
@ilia987,

The message "Driver grid-05.test.com:36315 disassociated! Shutting down" sounds like AM had trouble getting back to Driver, can you share below info:

- did you run spark in cluster or client mode?
- what is the full command?
- what's the error from client side where you ran spark-submit?
- what's the error in yarn side? As suggested by @AKR to share the entire application logs

Cheers
Eric