https://community.cloudera.com/t5/Support-Questions/Phoenix-driver-not-found-in-Spark-job/m-p/147501#M110040 <P>I've created a Spark streaming application (and swear a month or 2 ago I had this working) and it runs fine in Eclipse. When I run the job using spark-submit and specify the --jars including my application jars and /usr/hdp/current/phoenix-client/phoenix-client.jar (or skip the link and use /usr/hdp/current/phoenix-4.7.0.2.5.3.0-37-client.jar) I get a error indicating classNotFound: org.apache.phoenix.jdbc.PhoenixDriver.</P><P>In the YARN log output I can see in directory.info the following entries:</P><P>lrwxrwxrwx 1 yarn hadoop 70 Mar 7 15:37 phoenix-client.jar -&gt; /hadoop/yarn/local/usercache/jwatson/filecache/2288/phoenix-client.jar</P><P>3016594 100180 -r-x------ 1 yarn hadoop 102581542 Mar 7 15:37 ./phoenix-client.jar</P><P>in launch_container.sh I see the following:</P><P>ln -sf "/hadoop/yarn/local/usercache/jwatson/filecache/2288/phoenix-client.jar" "phoenix-client.jar"</P><P>So it seems the right things are happening. I finally broke down and put the following in the driver to see what I got for class files:</P><P>ClassLoader cl = ClassLoader.getSystemClassLoader(); URL[] urls = ((URLClassLoader)cl).getURLs(); for (URL url: urls) System.out.println(url.getFile());</P><P>And it shows none of the jar files I added via the --jars command for spark-submit. What am I missing.</P><P>As a corollary, should we build a fatjar instead and toss everything in that? What's the most efficient approach to not having to copy jar files that are already on the cluster servers (HDP 2.5.3)?</P> Thu, 09 Mar 2017 06:41:42 GMT jeff_watson 2017-03-09T06:41:42Z