Skip to main content
poorva
poorva
Bronze III
September 16, 2022
Solved

SparkContext was shut down

how to know why sparkcontext was shut down ??ERROR yarn.Client: Application diagnostics message: User class threw exception: org.apache.spark.SparkException: Job 1 cancelled because SparkContext was shut down

RangaReddy
RangaReddyAnswer
Gold ⭐️
September 16, 2022

Hi @poorva 

 

Please check the application logs for failed applications from Resource Manager UI, there exception message is printed. Fix the exception and resubmit the job.

 

View in thread

3 replies

RangaReddy
Gold ⭐️
RangaReddyAnswer
Gold ⭐️
September 16, 2022

Hi @poorva 

 

Please check the application logs for failed applications from Resource Manager UI, there exception message is printed. Fix the exception and resubmit the job.

 

Translate
vaishaakb
Gold ⭐️⭐️⭐️
vaishaakb
Gold ⭐️⭐️⭐️
September 19, 2022

Hello @poorva Did you get a chance to review the Failed Application logs from Resource Manager UI?

 

You can also share the exception from the same time frame so we can help you further with a plan of action. 

 

Let us know your thoughts.

Translate
VidyaSargur
Community Manager
VidyaSargur
Community Manager
September 26, 2022

@poorva, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. 

Translate
Regards, Vidya Sargur, Community Manager Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
Terms & ConditionsAccessibility statement