Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HDP_2.6.4_vmware_01_02_2018_1325: spark-submit error

Highlighted

HDP_2.6.4_vmware_01_02_2018_1325: spark-submit error

New Contributor

I am following the example at https://hortonworks.com/tutorial/spark-on-yarn-example/ but getting an error on the spark-submit command.

The error is:

Retrying connect to server: sandbox-hdp.hortonworks.com
/<my IP>:8032. Already tried 40 time(s); retry policy is RetryUpToMaximumCountWithF
ixedSleep(maxRetries=50, sleepTime=1000 MILLISECONDS) 

I am on a Mac host and opted for SPARK_MAJOR_VERSION 2. Please help.

2 REPLIES 2

Re: HDP_2.6.4_vmware_01_02_2018_1325: spark-submit error

Explorer

Hi @Saurav D, we updated this tutorial to work with our latest HDP 2.6.5 Sandbox (Hortonworks Latest Sandbox Downloads). Please try to run this tutorial again with the new environment and let us know if your issue still persists.

@cfarnes

Highlighted

Re: HDP_2.6.4_vmware_01_02_2018_1325: spark-submit error

Cloudera Employee

I agree with @acastro, Just ran the tutorial and it works like a charm on HDP 2.6.5

18/07/17 17:51:04 INFO scheduler.DAGScheduler: Job 0 finished: reduce at SparkPi.scala:36, took 7.331063 s
Pi is roughly 3.1402191402191404
Don't have an account?
Coming from Hortonworks? Activate your account here