Support Questions
Find answers, ask questions, and share your expertise

spark history server error class not found

Solved Go to solution

spark history server error class not found

Cloudera Employee

I am looking at a customer installation that has a spark history server problem: Exception in thread "main" java.lang.ClassNotFoundException: org.apache.spark.deploy.yarn.history.YarnHistoryProvider at java.net.URLClassLoader$1.run(URLClassLoader.java:366) Looking at the jar it is missing the YarnHistoryService any ideas how to get around this on this version: spark_2_3_4_0_3485-master.noarch

1 ACCEPTED SOLUTION

Accepted Solutions

Re: spark history server error class not found

Mentor
3 REPLIES 3

Re: spark history server error class not found

Mentor

Re: spark history server error class not found

Cloudera Employee

This is an upgraded cluster at one of our customers, I have no explanation to the missing class in the jar but I found that class in the pre upgraded jar. I was looking to make configuration changes - ended up swapping the jars - and the old one works !!

Re: spark history server error class not found

Mentor

That certainly works but going forward wouldn't it cause problems?