03-19-2018 12:09 PM
I followed this https://www.cloudera.com/documentation/spark2/latest/topics/spark2_installing.html to install the Spark 2.2.0.
csd file => SPARK2_ON_YARN-2.2.0.cloudera2.jar
There are two issue
1. metrics.properties.template missing from the path SPARK2-2.2.0.cloudera2-1.cdh5.12.0.p0.232957/lib/spark2/conf/
2. Another question does the restarting yarn and Cloudera manager will move or copy or set symlink of the conf files here(/opt/cloudera/parcels/SPARK2-2.2.0.cloudera2-1.cdh5.12.0.p0.232957/etc/spark2/conf.dist) because for spark 1.6.0 i can see the files here (/opt/cloudera/parcels/CDH/etc/spark/conf.dist)