Skip to main content
Marwn
Bronze ⭐️⭐️⭐️
October 20, 2021
Question

Spark is slow to start running

Hello,

 

After receiving the necessary resources from yarn (executors), my spark job doesnt start instantly like before.

It takes now 15 minute to start.

What spark is doing during this time ? And why the time went from a few seconds to 15 minutes ?

I use Spark 2.2 with scala on hadoop/yarn

1 reply

RangaReddy
Gold ⭐️
Gold ⭐️
October 28, 2021

Hi @Marwn 

 

Please check the application logs to identify why application startup is taking X mins. Without providing application logs very difficult to provide.

Translate