Hi Gautum, I have tried this property and it worked. But i have noticed that it only try 4 times, After that process didn't start. Are there any other configurations where i can provide the number of times process should restart?   Regards! Gaurav Garg ... View more

--conf "spark.driver.extraClassPath=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/jars/htrace-core-3.1.0-incubating.jar:/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hive/conf:/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hive/lib/*.jar" \ --conf "spark.executor.extraClassPath=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/jars/htrace-core-3.1.0-incubating.jar:/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hive/conf:/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hive/lib/*.jar" \ --conf "spark.driver.extraJavaOptions=-XX:MaxPermSize=1024m -XX:PermSize=256m" \ --conf "spark.executor.extraJavaOptions=-XX:MaxPermSize=1024m -XX:PermSize=256m" \ work for me ... View more

You can stop the services with the following: (another option is just to use restart, I like stop, verify all processes are gone/down then do the start when needed.)     Cloudera Manager Server: (stop agent, stop the server, stop database if using local postgres default ) sudo /sbin/service cloudera-scm-agent stop sudo /sbin/service cloudera-scm-server stop sudo /sbin/service cloudera-scm-server-db stop   Do the reverse to start:   sudo /sbin/service cloudera-scm-server-db start sudo /sbin/service cloudera-scm-server start sudo /sbin/service cloudera-scm-agent start   On the other nodes of  your servers in the cluster just stop/restart the agent. sudo /sbin/service cloudera-scm-agent stop sudo /sbin/service cloudera-scm-agent start or sudo /sbin/service cloudera-scm-agent restart     You can do the following to get a status of the services as well.   sudo /sbin/service cloudera-scm-server-db status sudo /sbin/service cloudera-scm-server status sudo /sbin/service cloudera-scm-agent status   May want to do a ps -ef |grep cloudera-scm to verify all processes are stopped on each server. ... View more