HDP_2.6.4_vmware_01_02_2018_1325: spark-submit error

[#1]

I am using HDP_2.6.4_vmware_01_02_2018_1325, and following the steps at https://hortonworks.com/tutorial/spark-on-yarn-example/

When I execute the spark-submit command, I get the below error:

Retrying connect to server: sandbox-hdp.hortonworks.com
/<masked IP>:8032. Already tried 40 time(s); retry policy is RetryUpToMaximumCountWithF
ixedSleep(maxRetries=50, sleepTime=1000 MILLISECONDS)          

I am using SPARK_MAJOR_VERSION=2 and my host is a Mac OS.

Please help.

[#2 · Accepted solution]

@Saurav D

Do you see any error/Warning on your Yarn logs? As we see and looks like resource manager port ?

Retrying connect to server: sandbox-hdp.hortonworks.com/<masked IP>:8032

.

Can we check if the port 8032 is opened and accessible?

# netstat -tnlpa | grep 8032

.

In Sandbox environment sometimes when we keep running the unwanted services then it creates a lots of load on the VM hence some services might not work properly sometimes. So you might want to stop some unwanted services in your sandbox and then try again.

[#3]

@Saurav D

Good to know that it resolved your issue. If it helped then please mark this HCC thread as answered by clicking on "Accept" link on the correct answer, That way it will help other HCC users to quickly find the answers.

[#4]

@Jay Kumar SenSharma, you were right: Yarn was not running. I manually started Yarn, and now the example is running fine.

Thanks very much!

[#5]

Great article if you are in the search of the best browser for your pc with more safety and security then just click here to get mozilla firefox for windows Mac and IOS devices without any charge.