https://community.cloudera.com/t5/Support-Questions/Fetch-distinct-values-of-a-column-in-Dataframe-using-Spark/m-p/174633#M136896 <A rel="user" href="https://community.cloudera.com/users/11441/kaznarasimhan.html" nodeid="11441">@Narasimhan Kazhiyur</A><P>When you run Spark in Yarn-cluster mode, your application jar needs to be shipped to the cluster. When you run in cluster mode, do you specify your application jar using application-jar option?</P><P>If not, please check the following link.</P><P><A href="http://spark.apache.org/docs/latest/submitting-applications.html" target="_blank">http://spark.apache.org/docs/latest/submitting-applications.html</A></P><P>and following link also to understand how cluster mode works.</P><P><A href="http://spark.apache.org/docs/latest/submitting-applications.html" target="_blank">http://spark.apache.org/docs/latest/submitting-applications.html</A></P> Mon, 15 Aug 2016 12:14:04 GMT mqureshi 2016-08-15T12:14:04Z