Spark submit fails, logs attached, ERROR CoarseGrainedExecutorBackend: Executor self-exiting due disassociated! Shutting down.

[#1]

approx 30% of the jobs i submit fails, here are the logs with the error

19/03/04 18:43:17 ERROR CoarseGrainedExecutorBackend: Executor self-exiting due to : Driver grid-05.test.com:36315 disassociated! Shutting down. 19/03/04 18:43:17 INFO DiskBlockManager: Shutdown hook called 19/03/04 18:43:17 INFO ShutdownHookManager: Shutdown hook called

any idea how i can resolve it ?

[#2]

Can anyone give idea to fix it ?

[#3]

Hi,

Could you please share the Entire application logs to analyse further?

Thanks

AKR

[#4]

@ilia987,

The message "Driver grid-05.test.com:36315 disassociated! Shutting down" sounds like AM had trouble getting back to Driver, can you share below info:

- did you run spark in cluster or client mode?
- what is the full command?
- what's the error from client side where you ran spark-submit?
- what's the error in yarn side? As suggested by @AKR to share the entire application logs

Cheers
Eric