question Re: "bad substitution" error running Spark on Yarn in Support Questions

question Re: "bad substitution" error running Spark on Yarn in Support Questions https://community.cloudera.com/t5/Support-Questions/quot-bad-substitution-quot-error-running-Spark-on-Yarn/m-p/288335#M213580 <P>This worked!</P><P> </P><P> </P><P>I already made these changes prior to running the last command.</P><P> </P><DIV class=""><DIV class=""><FONT face="Courier New">hdp-select status hadoop-client</FONT></DIV><DIV class=""> </DIV></DIV><DIV class=""> </DIV><DIV class="">Set a couple of parameters</DIV><DIV class=""><FONT face="Courier New">export HADOOP_OPTS="-Dhdp.version=2.6.1.0-129”</FONT></DIV><DIV class=""><FONT face="Courier New">export HADOOP_CONF_DIR=/etc/hadoop/conf</FONT></DIV><DIV class=""> </DIV><DIV class="">Source-in the environment</DIV><DIV class=""><FONT face="Courier New">source ~/get_env.sh</FONT></DIV><DIV class=""> </DIV><DIV class=""> </DIV><DIV class=""> </DIV><DIV class=""><DIV class=""><FONT face="Courier New">Included last two lines to $SPARK_HOME/conf/spark-defaults.conf</FONT></DIV><DIV class=""><SPAN class=""><FONT face="Courier New">spark.driver.extraJavaOptions   -Dhdp.version=2.6.1.0-129</FONT></SPAN></DIV><DIV class=""><SPAN class=""><FONT face="Courier New">spark.yarn.am.extraJavaOptions -Dhdp.version=2.6.1.0-129</FONT></SPAN></DIV></DIV><DIV class=""> </DIV><DIV class="">Added Hadoop version under Ambari / Yarn / Advanced / Custom:</DIV><DIV class=""> hdp.version=<SPAN class="">2.6.1.0-129</SPAN></DIV><DIV class=""><DIV class=""> </DIV><DIV class=""> </DIV><DIV class="">Ensure this runs okay </DIV><DIV class=""><FONT face="Courier New">yarn jar hadoop-mapreduce-examples.jar pi 5 5<BR /></FONT></DIV><DIV class=""> </DIV><DIV class="">Run spark pi example under yarn</DIV><DIV class=""> </DIV><DIV class=""><FONT face="Courier New">cd /home/spark/spark-2.4.4-bin-hadoop2.7</FONT></DIV><DIV class=""><FONT face="Courier New"> </FONT></DIV><DIV class=""><FONT face="Courier New">spark-submit   --class org.apache.spark.examples.SparkPi  --master yarn   --deploy-mode cluster   --executor-memory 2G  --num-executors 5  --executor-cores 2   --conf spark.authenticate.enableSaslEncryption=true   --conf spark.network.sasl.serverAlwaysEncrypt=true   --conf spark.authenticate=true   examples/jars/spark-examples_2.11-2.4.4.jar   100 </FONT></DIV></DIV> Sun, 26 Jan 2020 19:18:33 GMT Srini_hi 2020-01-26T19:18:33Z