About guthurti_tulasi

guthurti_tulasi · ‎08-19-2017

Can anyone explain spark.driver.extraclasspath , spark.executor.extraclasspath and --jars options in spark submit and in what scenarios we can use these options.

guthurti_tulasi · ‎08-19-2017

Issue is fixed after passing jars into --conf "spark.driver.ExtraClassPath and --conf "spark.executor.ExtraClassPath" into spark submit

guthurti_tulasi · ‎08-16-2017

Do you mean mixing class path on server side?Can you please explain here.

guthurti_tulasi · ‎08-16-2017

I didn't find spark-assembly-1.6xxxxx.jar file in horton repo.(So please make sure that you are not mixing the claspath to include both the JARs)Do you know how to verify mixing class paths on server side.On my cluster we have spar1.6.2 and spark2 also installed.

guthurti_tulasi · ‎08-16-2017

Thank you for your quick response.On server side it using the following assembly spark-assembly-1.6.2.2.5.3.44-1-hadoop2.7.3.2.5.3.44-1.jar and on driver side i am using spark-hive_2.10-1.6.2 jar file and am using hortonworks repository on driver side.I am completely block here and unable to move forward.I apperciate your help.

guthurti_tulasi · ‎08-16-2017

I am getting invalid class serialize exception spark submit client mode and it working good local mode.Can any one help me out. Exception details java.io.InvalidClassException:org.apache.spark.sql.hive.execution.InsertIntoHiveTable; local class incompatible: stream classdesc serialVersionUID=439602153812587, local class serailVersionUID=1424907733712746510

Online	Offline
Last Visited	‎06-11-2018 10:05 PM

Member Since	‎08-16-2017 05:33 AM
Last Visited	‎06-11-2018 10:05 PM
Posts	12
Kudos received	1

Cloudera Community

Can anyone explain spark.driver.extraclasspath and...

Re: java.io.InvalidClassException:org.apache.spark...

Re: java.io.InvalidClassException:org.apache.spark...

Re: java.io.InvalidClassException:org.apache.spark...

Re: java.io.InvalidClassException:org.apache.spark...

java.io.InvalidClassException:org.apache.spark.sql...