Spark2 service in the existing cluster

[#1]

In my cluster I have spark1.6 and I am trying to add spark2. I was able to add the service but spark2 service does not come up..

here is an extract from the logs :

Not sure why its checking at spark1.6 and complaining its already up and running

resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/hdp/current/spark2-historyserver/sbin/start-history-server.sh' returned 1. org.apache.spark.deploy.history.HistoryServer running as process 39259.  Stop it first

[#2]

Hi Kumar,

It could be the case that you have a stale SHS process, so work on stopping any SHS process as PID 39259 and/or remove "rm" the SHS process id file usually under /var/run/spark2, and the restart it again.