Where is $SPARK_HOME ?

[#1]

I want to execute "./sbin/start-master.sh", but I'm unable to locate this file in the /sbin folder. I wanted to find the file using echo $SPARK_HOME but the result is empty. I'm on HDP 2.4.

That leads to the question: Where is Spark?

[#2 · Accepted solution]

Normally it's under /usr/hdp/current/spark-client

[#3]

Sorry, too quick on the trigger.

Normally SPARK_HOME=/usr/hdp/current/spark-client

In my (old) sandbox the start_master.sh script is located at /usr/hdp/2.4.0.0-169/spark/sbin/start-master.sh.

[#4]

Sometimes asking the question is half the answer:

find . -name start-master.sh

gave

./usr/hdp/2.4.0.0-169/spark/sbin/start-master.sh

[#5]

You need to go where your Spark client is installed. Depending of your install/OS, it may be :

/usr/hdp/current/spark-client/sbin

Hope this helps.