Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

SparkContext was shut down

avatar
New Contributor

how to know why sparkcontext was shut down ??ERROR yarn.Client: Application diagnostics message: User class threw exception: org.apache.spark.SparkException: Job 1 cancelled because SparkContext was shut down

1 ACCEPTED SOLUTION

avatar
Master Collaborator

Hi @poorva 

 

Please check the application logs for failed applications from Resource Manager UI, there exception message is printed. Fix the exception and resubmit the job.

 

View solution in original post

3 REPLIES 3

avatar
Master Collaborator

Hi @poorva 

 

Please check the application logs for failed applications from Resource Manager UI, there exception message is printed. Fix the exception and resubmit the job.

 

avatar
Master Collaborator

Hello @poorva Did you get a chance to review the Failed Application logs from Resource Manager UI?

 

You can also share the exception from the same time frame so we can help you further with a plan of action. 

 

Let us know your thoughts.

avatar
Community Manager

@poorva, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. 



Regards,

Vidya Sargur,
Community Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community: