Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Spark is slow to start running

avatar
New Contributor

Hello,

 

After receiving the necessary resources from yarn (executors), my spark job doesnt start instantly like before.

It takes now 15 minute to start.

What spark is doing during this time ? And why the time went from a few seconds to 15 minutes ?

I use Spark 2.2 with scala on hadoop/yarn

1 REPLY 1

avatar
Super Collaborator

Hi @Marwn 

 

Please check the application logs to identify why application startup is taking X mins. Without providing application logs very difficult to provide.