Support Questions
Find answers, ask questions, and share your expertise

Who agreed with this topic


New Contributor


I am upgrading from hdp2.6.3 to hdp3.1.4. Post upgrade am getting the following error when running one of my jobs


Caused by: java.lang.ClassNotFoundException:
	at java.lang.ClassLoader.loadClass(
	at sun.misc.Launcher$AppClassLoader.loadClass(
	at java.lang.ClassLoader.loadClass(

I see that the jar containing this class is hbase-shaded-miscellaneous-2.2.0.jar and is present in 




I can see that the spark2-hdp-yarn-archive.tar.gz created in /hadoop/yarn/local/filecache/0/11837/spark2-hdp-yarn-archive.tar.gz does not contain this jar file.


When I add the jar explicity to my spark-submit command by appending it to --jars option and adding it to conf as below , I dont see this error ,

--conf "spark.driver.extraClassPath=/usr/hdp/



Progressing in above manner I then get another ClassNotfound for another shaded class in hbase-protocol-shaded- 


Can I get some pointers on what the issue may be.

Other jars like hbase-client- etc are not giving this issue.



Kevin Mathrani


Who agreed with this topic