Support Questions

Find answers, ask questions, and share your expertise

Why i am getting Caused by: java.lang.ClassNotFoundException: $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$anonfun$1 ?

I am using spark shell in yarn client mode i wanted to stop my current sc and deploy new one . i created a new rdd and the ran a reduce job. then i got this error

Caused by: java.lang.ClassNotFoundException: $iwC$iwC$iwC$iwC$iwC$iwC$iwC$iwC$anonfun$1 at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.serializer.JavaDeserializationStream$anon$1.resolveClass(JavaSerializer.scala:68) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1858) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1744) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2032) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1566) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2277) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2201) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2059) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1566) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2277) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2201) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2059) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1566) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2277) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2201) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2059) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1566) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:426) at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:76) at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:115) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61) at org.apache.spark.scheduler.Task.run(Task.scala:89) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:227) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

1 REPLY 1

Expert Contributor

Could you give some example code to reproduce your problem?