Can anyone explain spark.driver.extraclasspath and spark.executor.extraclasspath and --jars

[#1]

Can anyone explain spark.driver.extraclasspath , spark.executor.extraclasspath and --jars options in spark submit and in what scenarios we can use these options.

[#2 · Accepted solution]

The spark.driver.extraclasspath , spark.executor.extraclasspath is easy to understand. If you want all you spark job load a particular depency jars to drivers and executers then you can specify in those property. The --jars is if you want to add dependency jar to a spark job

[#3]

Hi,

The below mentioned links will more information on your clarifications

https://spark.apache.org/docs/latest/configuration.html

Thanks

Arun