Answer
Visitor
Posts: 1
Registered: ‎07-25-2018
Facing issue while launching spark job from outside the Virual box?
Hello Everyone,
Host machine: windows 7
Virtual box: cloudera quick start is running with spark(1.6.0 & scala:2.10.5) in standalone mode.
I am trying to submit spark job in standalone mode from host machine(i.e on windows) through eclipse ide by providing master ip but facing error as "java.lang.RuntimeException: java.io.InvalidClassException: org.apache.spark.rpc.netty.RequestMessage; local class incompatible: stream classdesc serialVersionUID = -5447855329526097695, local class serialVersionUID = -2221986757032131007".
I searched on internet,everyone is saying that it's version mismatch between spark app and spark which is installed on cloudera vm so i tried below links but those did not work for me.for workaround ,I have added dependency of spark core in pom.xml with the same spark version which is installed in cloudera vm but still am not able to reso
lve.

Links
1) https://stackoverflow.com/questions/35485662/local-class-incompatible-exception-when-running-spark-s...
2) https://stackoverflow.com/questions/38559597/failed-to-connect-to-spark-masterinvalidclassexception-...

Note:The spark web UI is accessible to me outside of vm using (192.168.x.x) that is eth1 inet address.
Please help me to resolve this issue.
Thanks
Other Answers: 1
Cloudera Employee
Posts: 2
Registered: ‎06-12-2014
Answered

Hi Manus,

 

Are you running CDH6.0beta in virtual box? Because CDH6.0beta 1 only includes Spark 2.2 and Scala 2.11. In addition, standalone mode is no lonber supported in CDH6.x. 

 

Thanks,

Kostas

Kostas Sakellis