question Re: Can anyone explain spark.driver.extraclasspath and spark.executor.extraclasspath and --jars in Archives of Support Questions (Read Only)

Can anyone explain spark.driver.extraclasspath and spark.executor.extraclasspath and --jars

guthurti_tulasi — Sun, 20 Aug 2017 00:25:14 GMT

Can anyone explain spark.driver.extraclasspath , spark.executor.extraclasspath and --jars options in spark submit and in what scenarios we can use these options.

Re: Can anyone explain spark.driver.extraclasspath and spark.executor.extraclasspath and --jars

xin_wang — Sun, 20 Aug 2017 07:08:09 GMT

The spark.driver.extraclasspath , spark.executor.extraclasspath is easy to understand. If you want all you spark job load a particular depency jars to drivers and executers then you can specify in those property. The --jars is if you want to add dependency jar to a spark job

Re: Can anyone explain spark.driver.extraclasspath and spark.executor.extraclasspath and --jars

AKR — Mon, 06 Jan 2020 17:37:58 GMT

Hi,

The below mentioned links will more information on your clarifications

https://spark.apache.org/docs/latest/configuration.html

Thanks

Arun