Support Questions

Find answers, ask questions, and share your expertise


New Contributor


I am upgrading from hdp2.6.3 to hdp3.1.4. Post upgrade am getting the following error when running one of my jobs


Caused by: java.lang.ClassNotFoundException:
	at java.lang.ClassLoader.loadClass(
	at sun.misc.Launcher$AppClassLoader.loadClass(
	at java.lang.ClassLoader.loadClass(

I see that the jar containing this class is hbase-shaded-miscellaneous-2.2.0.jar and is present in 




I can see that the spark2-hdp-yarn-archive.tar.gz created in /hadoop/yarn/local/filecache/0/11837/spark2-hdp-yarn-archive.tar.gz does not contain this jar file.


When I add the jar explicity to my spark-submit command by appending it to --jars option and adding it to conf as below , I dont see this error ,

--conf "spark.driver.extraClassPath=/usr/hdp/



Progressing in above manner I then get another ClassNotfound for another shaded class in hbase-protocol-shaded- 


Can I get some pointers on what the issue may be.

Other jars like hbase-client- etc are not giving this issue.



Kevin Mathrani



Get all the classes listed as part of error(ClassNotfound) and add those corrresponding jars to spark.driver.extraClassPath and spark.executor.extraClassPath.


It worked for us, when all the jars corresponding the class in the error was added.