Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.



New Contributor


I am upgrading from hdp2.6.3 to hdp3.1.4. Post upgrade am getting the following error when running one of my jobs


Caused by: java.lang.ClassNotFoundException:
	at java.lang.ClassLoader.loadClass(
	at sun.misc.Launcher$AppClassLoader.loadClass(
	at java.lang.ClassLoader.loadClass(

I see that the jar containing this class is hbase-shaded-miscellaneous-2.2.0.jar and is present in 




I can see that the spark2-hdp-yarn-archive.tar.gz created in /hadoop/yarn/local/filecache/0/11837/spark2-hdp-yarn-archive.tar.gz does not contain this jar file.


When I add the jar explicity to my spark-submit command by appending it to --jars option and adding it to conf as below , I dont see this error ,

--conf "spark.driver.extraClassPath=/usr/hdp/



Progressing in above manner I then get another ClassNotfound for another shaded class in hbase-protocol-shaded- 


Can I get some pointers on what the issue may be.

Other jars like hbase-client- etc are not giving this issue.



Kevin Mathrani



Re: java.lang.ClassNotFoundException:

Get all the classes listed as part of error(ClassNotfound) and add those corrresponding jars to spark.driver.extraClassPath and spark.executor.extraClassPath.


It worked for us, when all the jars corresponding the class in the error was added.

Don't have an account?
Coming from Hortonworks? Activate your account here