Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Spark is slow to start running

avatar
Visitor

Hello,

 

After receiving the necessary resources from yarn (executors), my spark job doesnt start instantly like before.

It takes now 15 minute to start.

What spark is doing during this time ? And why the time went from a few seconds to 15 minutes ?

I use Spark 2.2 with scala on hadoop/yarn

1 REPLY 1

avatar
Master Collaborator

Hi @Marwn 

 

Please check the application logs to identify why application startup is taking X mins. Without providing application logs very difficult to provide.