Support Questions

Find answers, ask questions, and share your expertise

Spark is slow to start running

avatar
New Contributor

Hello,

 

After receiving the necessary resources from yarn (executors), my spark job doesnt start instantly like before.

It takes now 15 minute to start.

What spark is doing during this time ? And why the time went from a few seconds to 15 minutes ?

I use Spark 2.2 with scala on hadoop/yarn

1 REPLY 1

avatar
Master Collaborator

Hi @Marwn 

 

Please check the application logs to identify why application startup is taking X mins. Without providing application logs very difficult to provide.