How to start spark console

[#1]

Hi,

I have installed Hortonworks HDP in my system. I have sandbox login command prompt. How to start spark from sandbox command prompt.

Thanks

Ashwin

[#2 · Accepted solution]

Ashwin - You can start the spark shell by running /usr/hdp/current/spark-client/bin/spark-shell in the sandbox.

[#3]

@ashwin jayrama

Good doc http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_spark-guide/content/ch_installing-spark.h...

For manual process http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_installing_manually_book/content/ch_insta...

[#4]

@ashwin jayrama

Set $SPARK_HOME to /usr/hdp/current/spark & add the classpath. After which you can start the spark shell using:

spark-shell --num-executors <n> --executor-memory <n> --master <yarn OR yarn-client OR local>

[#5]

I have downloaded HDP 2.6 for VMware and imported the image in vmware 12.1 ver.

Able to log on but none of the commands like jps, ipconfig, java -version are working.

Attached screenshot, please help me here

Thanks,