Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to start spark console

Solved Go to solution

How to start spark console

New Contributor

Hi,

I have installed Hortonworks HDP in my system. I have sandbox login command prompt. How to start spark from sandbox command prompt.

Thanks

Ashwin

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: How to start spark console

Guru

Ashwin - You can start the spark shell by running /usr/hdp/current/spark-client/bin/spark-shell in the sandbox.

4 REPLIES 4
Highlighted

Re: How to start spark console

Guru

Ashwin - You can start the spark shell by running /usr/hdp/current/spark-client/bin/spark-shell in the sandbox.

Re: How to start spark console

Guru
@ashwin jayrama

Set $SPARK_HOME to /usr/hdp/current/spark & add the classpath. After which you can start the spark shell using:

spark-shell --num-executors <n> --executor-memory <n> --master <yarn OR yarn-client OR local>

Re: How to start spark console

New Contributor

I have downloaded HDP 2.6 for VMware and imported the image in vmware 12.1 ver.

Able to log on but none of the commands like jps, ipconfig, java -version are working.

Attached screenshot, please help me here

Thanks,