Hi Team,
I need some clarification to understand spark history server web UI.
On spark history server I can see executor status as active on one of spark application.
as per my understanding after spark context is exited spark application logs are moved to spark history server and it should show executor status as dead.
my questions is WHY EXECUTOR STATUS IS SHOWING IS ACTIVE ON SPARK HISTORY SERVER ( highlighted in yellow )
I have checked the status of this application from backend (using yarn command)
it shows
Progress : 100%
State : FINISHED
Final-State : SUCCEEDED
Thanks,
Shahrukh Khan