Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

spark-shell won't start properly in 5.4.1

spark-shell won't start properly in 5.4.1

Explorer

This is a new 5.4.1 install.  On my gateway machine when I first try to run spark-shell, I get a long stream of messages like this for a minute or so:

 

 INFO Client: Application report for application_1433427242487_0001 (state: ACCEPTED)

 

then the last one says FAILED. 

 

Logs say this:

 

15/06/05 14:20:00 ERROR yarn.ApplicationMaster: Uncaught exception: 
org.apache.spark.SparkException: Failed to connect to driver!

 

I tried running the shell on one of the cluster machines directly and it seems to work fine.  I'm assuming this is a simple configuration error.

 

Thanks.

Don't have an account?
Coming from Hortonworks? Activate your account here