Created 06-22-2018 06:27 AM
I am following the example at https://hortonworks.com/tutorial/spark-on-yarn-example/ but getting an error on the spark-submit command.
The error is:
Retrying connect to server: sandbox-hdp.hortonworks.com /<my IP>:8032. Already tried 40 time(s); retry policy is RetryUpToMaximumCountWithF ixedSleep(maxRetries=50, sleepTime=1000 MILLISECONDS)
I am on a Mac host and opted for SPARK_MAJOR_VERSION 2. Please help.
Created 07-17-2018 05:45 PM
Hi @Saurav D, we updated this tutorial to work with our latest HDP 2.6.5 Sandbox (Hortonworks Latest Sandbox Downloads). Please try to run this tutorial again with the new environment and let us know if your issue still persists.
Created 07-17-2018 05:54 PM
I agree with @acastro, Just ran the tutorial and it works like a charm on HDP 2.6.5
18/07/17 17:51:04 INFO scheduler.DAGScheduler: Job 0 finished: reduce at SparkPi.scala:36, took 7.331063 s Pi is roughly 3.1402191402191404