https://community.cloudera.com/t5/Support-Questions/Difference-between-local-vs-yarn-cluster-vs-yarn-client-for/m-p/161248#M123627 <P><STRONG>local[*]</STRONG></P><PRE>new SparkConf() .setMaster("local[2]")</PRE><UL> <LI>This is specific to run the job in local mode</LI><LI> This is specifically used to test the code in small amount of data in local environment</LI><LI>It Does not provide the advantages of distributed environment</LI><LI>* is the number of cpu cores to be allocated to perform the local operation</LI><LI>It helps in debugging the code by applying breakpoints while running from Eclipse or IntelliJ</LI></UL><P><STRONG> </STRONG></P><P><STRONG>yarn-client</STRONG></P><PRE>--master yarn --deploy-mode client</PRE><UL> <LI>Yarn client mode: your driver program is running on the yarn client where you type the command to submit the spark application (may not be a machine in the yarn cluster). In this mode, although the drive program is running on the client machine, the tasks are executed on the executors in the node managers of the YARN cluster</LI></UL><P><STRONG>yarn-cluster</STRONG></P><PRE>--master yarn --deploy-mode cluster</PRE><UL> <LI>This is the most advisable pattern for executing/submitting your spark jobs in production</LI><LI>Yarn cluster mode: Your driver program is running on the cluster master machine where you type the command to submit the spark application</LI></UL> Wed, 22 Mar 2017 13:31:44 GMT aaditya_a_deshp 2017-03-22T13:31:44Z