I am running spark job using DSE not yarn client/cluster mode, herewith i am including spark submit command for your reference, -- spark-submit \ --driver-java-options %%JAVA_OPTIONS%% --driver-memory 6g \ --master dse://?workpool=default \ --deploy-mode cluster \ --supervise \ --conf spark.executor.extraJavaOptions=%%EXECUTOR_JAVA_OPTIONS%% --total-executor-cores 6 --executor-memory 6g --num-executors 6 \ --conf spark.driver.extraClassPath=${CLASSPATH} --conf spark.executor.extraClassPath=${CLASSPATH} \ %%ADDITIONAL_SPARK_SUBMIT_CONFIGS%% \ --class com.test.start.RptProcessor file:%%JAR_PATH%%
... View more
