Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark -Shell does not start

Spark -Shell does not start

New Contributor

When I try to start spark-shell using Cloudera quick start VM 5.8 and 5.10 it just hangs and does not do anything,

is it any solution available for this.I have attached the screen shot. Any help ?screen shot.PNG

 Spark services are running

3 REPLIES 3

Re: Spark -Shell does not start

Champion

For some strange reason I cant open ur screenshot .

could you paste the error in the Insert code tag. 

 

Could you let me know if you had set your Java_home path  and Spark_home ? 

master and worker node status ?

what type of spark are you trying 

 

  • Standalone - meaning Spark will manage its own cluster
  • YARN - using Hadoop's YARN resource manager
  • Mesos - 

try this command  -  in your command line prompt 

SPARK_HOME/bin/pyspark

or

SPARK_HOME/bin/spark-shell

 

 

 

Re: Spark -Shell does not start

New Contributor

Hi,

 

Thanks for the response. I am using cloudera quick start VM 5.10 with 16 GB RAM.I tried the below path

 

/usr/lib/spark>spark-shell

 

 

However all it says 

 

Service SparkUI could not bind on port 4040.Attempting port 4041

 

and hangs...means does not proceed further

 

 

Highlighted

Re: Spark -Shell does not start

Rising Star
how did you solve this?