https://community.cloudera.com/t5/Support-Questions/spark-shell-master-yarn-error-in-HDP-2-6-5/m-p/281527#M209423 <P>Here are newly imported HDP 2.6.5 Sandbox spark-shell --master yarn</P><LI-CODE lang="markup">[root@sandbox-hdp ~]# spark-shell --master yarn SPARK_MAJOR_VERSION is set to 2, using Spark2 Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). Spark context Web UI available at &lt;a href="http://sandbox-hdp.hortonworks.com:4040" target="_blank"&gt;http://sandbox-hdp.hortonworks.com:4040&lt;/a&gt; Spark context available as 'sc' (master = yarn, app id = application_1572283124735_0001). Spark session available as 'spark'. Welcome to ____ __ / __/__ ___ _____/ /__ _\ \/ _ \/ _ `/ __/ '_/ /___/ .__/\_,_/_/ /_/\_\ version 2.3.0.2.6.5.0-292 /_/ Using Scala version 2.11.8 (OpenJDK 64-Bit Server VM, Java 1.8.0_171) Type in expressions to have them evaluated. Type :help for more information. scala&gt;</LI-CODE> Tue, 29 Oct 2019 01:45:53 GMT erkansirin78 2019-10-29T01:45:53Z