Support Questions
Find answers, ask questions, and share your expertise

How to start spark console

Solved Go to solution

How to start spark console

New Contributor

Hi,

I have installed Hortonworks HDP in my system. I have sandbox login command prompt. How to start spark from sandbox command prompt.

Thanks

Ashwin

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: How to start spark console

Guru

Ashwin - You can start the spark shell by running /usr/hdp/current/spark-client/bin/spark-shell in the sandbox.

View solution in original post

4 REPLIES 4
Highlighted

Re: How to start spark console

Guru

Ashwin - You can start the spark shell by running /usr/hdp/current/spark-client/bin/spark-shell in the sandbox.

View solution in original post

Highlighted

Re: How to start spark console

Guru
@ashwin jayrama

Set $SPARK_HOME to /usr/hdp/current/spark & add the classpath. After which you can start the spark shell using:

spark-shell --num-executors <n> --executor-memory <n> --master <yarn OR yarn-client OR local>

Highlighted

Re: How to start spark console

New Contributor

I have downloaded HDP 2.6 for VMware and imported the image in vmware 12.1 ver.

Able to log on but none of the commands like jps, ipconfig, java -version are working.

Attached screenshot, please help me here

Thanks,

Don't have an account?