Created on 05-10-2017 03:09 PM - edited 09-16-2022 04:35 AM
When I try to start spark-shell using Cloudera quick start VM 5.8 and 5.10 it just hangs and does not do anything,
is it any solution available for this.I have attached the screen shot. Any help ?
Spark services are running
Created on 05-10-2017 08:04 PM - edited 05-10-2017 08:06 PM
For some strange reason I cant open ur screenshot .
could you paste the error in the Insert code tag.
Could you let me know if you had set your Java_home path and Spark_home ?
master and worker node status ?
what type of spark are you trying
try this command - in your command line prompt
SPARK_HOME/bin/pyspark
or
SPARK_HOME/bin/spark-shell
Created 05-11-2017 09:04 PM
Hi,
Thanks for the response. I am using cloudera quick start VM 5.10 with 16 GB RAM.I tried the below path
/usr/lib/spark>spark-shell
However all it says
Service SparkUI could not bind on port 4040.Attempting port 4041
and hangs...means does not proceed further
Created 09-02-2018 09:35 AM
Created 06-14-2021 03:19 PM
This weekend we encounter the same issue.
we changed the resource manager to standby on the current node and made active on another node.
spark-shell is working.
Still problem exists on original node. Unable to identify the issue
Created 06-15-2021 02:23 AM
@sridhar-exelon as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.
Regards,
Vidya Sargur,Created 06-15-2021 11:08 AM
Thank you Vidya
Created 06-15-2021 05:19 AM
I think in my case the issue was with multiple version of java. I dont remember exactly its been a while