Reply
New Contributor
Posts: 3
Registered: ‎05-09-2017

Spark -Shell does not start

[ Edited ]

When I try to start spark-shell using Cloudera quick start VM 5.8 and 5.10 it just hangs and does not do anything,

is it any solution available for this.I have attached the screen shot. Any help ?screen shot.PNG

 Spark services are running

Champion
Posts: 281
Registered: ‎05-16-2016

Re: Spark -Shell does not start

[ Edited ]

For some strange reason I cant open ur screenshot .

could you paste the error in the Insert code tag. 

 

Could you let me know if you had set your Java_home path  and Spark_home ? 

master and worker node status ?

what type of spark are you trying 

 

  • Standalone - meaning Spark will manage its own cluster
  • YARN - using Hadoop's YARN resource manager
  • Mesos - 

try this command  -  in your command line prompt 

SPARK_HOME/bin/pyspark

or

SPARK_HOME/bin/spark-shell

 

 

 

Highlighted
New Contributor
Posts: 3
Registered: ‎05-09-2017

Re: Spark -Shell does not start

Hi,

 

Thanks for the response. I am using cloudera quick start VM 5.10 with 16 GB RAM.I tried the below path

 

/usr/lib/spark>spark-shell

 

 

However all it says 

 

Service SparkUI could not bind on port 4040.Attempting port 4041

 

and hangs...means does not proceed further

 

 

Announcements