Hi, When I'm running Sample Spark Job in client mode it executing and when I run the same job in cluster mode it's failing. May I know the reason. Client mode: ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client --num-executors 1 --driver-memory 512m --executor-memory 512m --executor-cores 1 lib/spark-examples*.jar 10 Cluster mode: ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn --deploy-mode cluster --num-executors 3 --driver-memory 4g --executor-memory 2g --executor-cores 1 lib/spark-examples*.jar 10 Error message: yarn logs -applicationId <applicationnumber> output: Container: container_1466521315275_0219_02_000001 on hostname.domain.com_45454 ========================================================================================== LogType:stderr Log Upload Time:Fri Jun 24 14:11:39 -0500 2016 LogLength:88 Log Contents: Error: Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster End of LogType:stderr LogType:stdout Log Upload Time:Fri Jun 24 14:11:39 -0500 2016 LogLength:0 Log Contents: End of LogType:stdout Spark-default.conf file: spark.driver.extraJavaOptions -Dhdp.version=2.3.2.0-2950 spark.history.kerberos.enabled true spark.history.kerberos.keytab /etc/security/keytabs/spark.headless.keytab spark.history.kerberos.principal spark-hdp@DOMAIN>COM spark.history.provider org.apache.spark.deploy.yarn.history.YarnHistoryProvider spark.history.ui.port 18080 spark.yarn.am.extraJavaOptions -Dhdp.version=2.3.2.0-2950 spark.yarn.containerLauncherMaxThreads 25 spark.yarn.driver.memoryOverhead 384 spark.yarn.executor.memoryOverhead 384 spark.yarn.historyServer.address sparkhistory.domain.com:18080 spark.yarn.max.executor.failures 3 spark.yarn.preserve.staging.files false spark.yarn.queue default spark.yarn.scheduler.heartbeat.interval-ms 5000 spark.yarn.services org.apache.spark.deploy.yarn.history.YarnHistoryService spark.yarn.submit.file.replication 3 Any help is highly appreciated and thanks in advance. ... View more