Support Questions
Find answers, ask questions, and share your expertise

Can anyone explain spark.driver.extraclasspath and spark.executor.extraclasspath and --jars

Solved Go to solution

Can anyone explain spark.driver.extraclasspath and spark.executor.extraclasspath and --jars

Can anyone explain spark.driver.extraclasspath , spark.executor.extraclasspath and --jars options in spark submit and in what scenarios we can use these options.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Can anyone explain spark.driver.extraclasspath and spark.executor.extraclasspath and --jars

Explorer

The spark.driver.extraclasspath , spark.executor.extraclasspath is easy to understand. If you want all you spark job load a particular depency jars to drivers and executers then you can specify in those property. The --jars is if you want to add dependency jar to a spark job

View solution in original post

2 REPLIES 2

Re: Can anyone explain spark.driver.extraclasspath and spark.executor.extraclasspath and --jars

Explorer

The spark.driver.extraclasspath , spark.executor.extraclasspath is easy to understand. If you want all you spark job load a particular depency jars to drivers and executers then you can specify in those property. The --jars is if you want to add dependency jar to a spark job

View solution in original post

Re: Can anyone explain spark.driver.extraclasspath and spark.executor.extraclasspath and --jars

Cloudera Employee

Hi,

 

The below mentioned links will more information on your clarifications

https://spark.apache.org/docs/latest/configuration.html

 

Thanks

Arun