Support Questions
Find answers, ask questions, and share your expertise

debug spark hung process

Expert Contributor

how do we troubleshoot spark hung jobs?

have a job where several executers execute in no time and last few executers hung and there are running since 24 hrs.

trying to understand what that process is doing? where it got hung.

1 REPLY 1

Explorer

You can login to resource manager url at port 8088 get the application Id specific to the submitted job,then run the following command to see the log info

yarn logs -applicationId <application_id> | more