https://community.cloudera.com/t5/Support-Questions/How-many-number-of-executors-will-be-created-for-a-spark/m-p/186504#M148606 <P>If you are running on cluster mode, you need to set the number of executors while submitting the JAR or you can manually enter it in the code. The former way is better</P><PRE>spark-submit \ --master yarn-cluster \ --class com.yourCompany.code \ --executor-memory 32G \ --num-executors 5 \ --driver-memory 4g \ --executor-cores 3 \ --queue parsons \ YourJARfile.jar \ </PRE><P>If running locally,</P><PRE>spark-shell --master yarn --num-executors 6 --driver-memory 5g --executor-memory 7g</PRE> Tue, 04 Apr 2017 22:49:35 GMT adnanalvee 2017-04-04T22:49:35Z