This is a new 5.4.1 install. On my gateway machine when I first try to run spark-shell, I get a long stream of messages like this for a minute or so:
INFO Client: Application report for application_1433427242487_0001 (state: ACCEPTED)
then the last one says FAILED.
Logs say this:
15/06/05 14:20:00 ERROR yarn.ApplicationMaster: Uncaught exception:
org.apache.spark.SparkException: Failed to connect to driver!
I tried running the shell on one of the cluster machines directly and it seems to work fine. I'm assuming this is a simple configuration error.