Support Questions
Find answers, ask questions, and share your expertise

I am getting Exception in thread "main" java.lang.NoSuchMethodError: scala.runtime.VolatileObjectRef.zero()Lscala/runtime/VolatileObjectRef; exception while submiting a job.

Explorer
 
13 REPLIES 13

Explorer

thanks Arun for your response.

I have tried in scala IDE by creating maven project and when ever I am adding dependency of spark getting compile time error for which I couldn't proceed. I am using HDP 2.4 which has spark 1.6.0 and scala 2.10.5.

I am not sure which scala IDE and what versions I have to use. please suggest me. I just want to build a jar and submit the job.

Super Collaborator

Have not tried out muck with maven for spark, but I have a sample here. You can checkout the same project (POM) and add the necessary hive dependancy and add your code. https://github.com/ak-arun/spark/tree/master/spark-java-rdd-dataframe

Explorer

Thanks Arun. I am able to create jars 🙂