Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

What is meaning of Spark executor status as active on Spark History Server

avatar
Contributor

Hi Team,

 

I need some clarification to understand spark history server web UI.

 

On spark history server I can see executor status as active on one of spark application.

as per my understanding after spark context is exited spark application logs are moved to spark history server and it should show executor status as dead.

 

Shahrukh_0-1639806726074.png

my questions is WHY EXECUTOR STATUS IS SHOWING IS ACTIVE ON SPARK HISTORY SERVER ( highlighted in yellow )

 

I have checked the status of this application from backend (using yarn command)

it shows 

Progress : 100%
State : FINISHED
Final-State : SUCCEEDED

Thanks,

Shahrukh Khan

0 REPLIES 0