https://community.cloudera.com/t5/Archives-of-Support-Questions/Spark-Testing-base-1-6-1-0-3-3-for-spark-version-2-0-2-is/m-p/163761#M49492 <P>A needed class was not found. This could be due to an error in your runpath. Missing class: org/apache/spark/Logging java.lang.NoClassDefFoundError: org/apache/spark/Logging</P><P><A href="https://community.hortonworks.com/questions/58286/noclassdeffounderror-orgapachesparklogging-using-s.html" target="_blank">https://community.hortonworks.com/questions/58286/noclassdeffounderror-orgapachesparklogging-using-s.html</A></P><P>Looked at the above question i think its valid for spark prior to 2.0 but iam looking for 2.0.2 <span class="lia-unicode-emoji" title=":slightly_smiling_face:">🙂</span></P><P>I tried adding dependencies in sbt for Spark streaming, twitter and many more. Still i get this error for spark 2.0.2. Any ideas how to get this resolved? Thank you</P> Tue, 20 Dec 2016 19:43:22 GMT bigspark 2016-12-20T19:43:22Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Spark-Testing-base-1-6-1-0-3-3-for-spark-version-2-0-2-is/m-p/163761#M49492 <P>A needed class was not found. This could be due to an error in your runpath. Missing class: org/apache/spark/Logging java.lang.NoClassDefFoundError: org/apache/spark/Logging</P><P><A href="https://community.hortonworks.com/questions/58286/noclassdeffounderror-orgapachesparklogging-using-s.html" target="_blank">https://community.hortonworks.com/questions/58286/noclassdeffounderror-orgapachesparklogging-using-s.html</A></P><P>Looked at the above question i think its valid for spark prior to 2.0 but iam looking for 2.0.2 <span class="lia-unicode-emoji" title=":slightly_smiling_face:">🙂</span></P><P>I tried adding dependencies in sbt for Spark streaming, twitter and many more. Still i get this error for spark 2.0.2. Any ideas how to get this resolved? Thank you</P> Tue, 20 Dec 2016 19:43:22 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Spark-Testing-base-1-6-1-0-3-3-for-spark-version-2-0-2-is/m-p/163761#M49492 bigspark 2016-12-20T19:43:22Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Spark-Testing-base-1-6-1-0-3-3-for-spark-version-2-0-2-is/m-p/163762#M49493 <P>org,apache.spark.Logging was a private api in 2.0</P><P>It was always marked as a @Private, but was exposed till 1.6; and this was tightened in 2.0 to remove its visibility.</P><P>Bottomline is, you cant depend on it; and have to modify code to remove dependency on the trait..</P><P>Regards,</P><P>Mridul</P> Wed, 21 Dec 2016 01:55:53 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Spark-Testing-base-1-6-1-0-3-3-for-spark-version-2-0-2-is/m-p/163762#M49493 mmuralidharan 2016-12-21T01:55:53Z https://community.cloudera.com/t5/Archives-of-Support-Questions/Spark-Testing-base-1-6-1-0-3-3-for-spark-version-2-0-2-is/m-p/163763#M49494 <P><A rel="user" href="https://community.cloudera.com/users/15023/mmuralidharan.html" nodeid="15023">@Mridul M</A> Thanks for the reply. Actually i was using the old version of spark testing base. Didn't know there was a 2.0.2 version. Holden karau pointed me to maven central where i found the latest version of spark testing base. In github readme of spark testing base it was mentioned 1.6 so i assumed the latest version was 1.6. But now its sorted and spark 2.0.2 Dataframe testing works for me. In case people might need this it also needs Hive dependency. Currently its new and couldnt find forums in spark 2.0 testing so iam posting this might help save time for other developers <span class="lia-unicode-emoji" title=":slightly_smiling_face:">🙂</span></P> Wed, 21 Dec 2016 17:31:53 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/Spark-Testing-base-1-6-1-0-3-3-for-spark-version-2-0-2-is/m-p/163763#M49494 bigspark 2016-12-21T17:31:53Z