question Re: How to start spark console in Archives of Support Questions (Read Only)

How to start spark console

ashwin_jayarama — Fri, 15 Jan 2016 05:35:31 GMT

Hi,

I have installed Hortonworks HDP in my system. I have sandbox login command prompt. How to start spark from sandbox command prompt.

Thanks

Ashwin

jdyer — Fri, 15 Jan 2016 05:37:48 GMT

Ashwin - You can start the spark shell by running /usr/hdp/current/spark-client/bin/spark-shell in the sandbox.

nsabharwal — Fri, 15 Jan 2016 05:38:28 GMT

vjain — Mon, 18 Jan 2016 23:13:03 GMT

Set $SPARK_HOME to /usr/hdp/current/spark & add the classpath. After which you can start the spark shell using:

spark-shell --num-executors <n> --executor-memory <n> --master <yarn OR yarn-client OR local>

hussnainahmad85 — Thu, 08 Jun 2017 20:09:36 GMT

I have downloaded HDP 2.6 for VMware and imported the image in vmware 12.1 ver.

Able to log on but none of the commands like jps, ipconfig, java -version are working.

Attached screenshot, please help me here

Thanks,