Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark submit fails, logs attached, ERROR CoarseGrainedExecutorBackend: Executor self-exiting due disassociated! Shutting down.

Spark submit fails, logs attached, ERROR CoarseGrainedExecutorBackend: Executor self-exiting due disassociated! Shutting down.

New Contributor

approx 30% of the jobs i submit fails, here are the logs with the error

19/03/04 18:43:17 ERROR CoarseGrainedExecutorBackend: Executor self-exiting due to : Driver grid-05.test.com:36315 disassociated! Shutting down. 19/03/04 18:43:17 INFO DiskBlockManager: Shutdown hook called 19/03/04 18:43:17 INFO ShutdownHookManager: Shutdown hook called


any idea how i can resolve it ?

3 REPLIES 3

Re: Spark submit fails, logs attached, ERROR CoarseGrainedExecutorBackend: Executor self-exiting due disassociated! Shutting down.

New Contributor
Can anyone give idea to fix it ?

Re: Spark submit fails, logs attached, ERROR CoarseGrainedExecutorBackend: Executor self-exiting due disassociated! Shutting down.

Cloudera Employee

Hi,

 

Could you please share the Entire application logs to analyse further?

 

Thanks

AKR

Highlighted

Re: Spark submit fails, logs attached, ERROR CoarseGrainedExecutorBackend: Executor self-exiting due disassociated! Shutting down.

Guru
@ilia987,

The message "Driver grid-05.test.com:36315 disassociated! Shutting down" sounds like AM had trouble getting back to Driver, can you share below info:

- did you run spark in cluster or client mode?
- what is the full command?
- what's the error from client side where you ran spark-submit?
- what's the error in yarn side? As suggested by @AKR to share the entire application logs

Cheers
Eric