https://community.cloudera.com/t5/Support-Questions/Local-Spark-Development-against-a-remote-cluster/m-p/104084#M66981 <P><A rel="user" href="https://community.cloudera.com/users/896/ehanson.html" nodeid="896">@Eric Hanson</A> Which repository are you getting the spark libraries from? Use the hortonworks repo. Check out this documentation on how to build spark streaming apps. It can be adapted to SBT an non-streaming apps.</P><P><A href="http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_spark-component-guide/content/using-spark-streaming.html">http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_spark-component-guide/content/using-spark-streaming.html</A></P><P>Also HDP 2.5 includes two different versions of spark. Check the settings for SPARK_HOME. For 1.6 use:</P><PRE><CODE>exportSPARK_HOME=/usr/hdp/current/spark-client</CODE></PRE><PRE><CODE>export SPARK_MAJOR_VERSION=1 </CODE></PRE> Tue, 14 Feb 2017 05:33:41 GMT Carolyn 2017-02-14T05:33:41Z