question HDP_2.6.4_vmware_01_02_2018_1325: spark-submit error in Archives of Support Questions (Read Only)

HDP_2.6.4_vmware_01_02_2018_1325: spark-submit error

askforsaurav — Fri, 22 Jun 2018 13:26:18 GMT

I am using HDP_2.6.4_vmware_01_02_2018_1325, and following the steps at https://hortonworks.com/tutorial/spark-on-yarn-example/

When I execute the spark-submit command, I get the below error:

Retrying connect to server: sandbox-hdp.hortonworks.com
/<masked IP>:8032. Already tried 40 time(s); retry policy is RetryUpToMaximumCountWithF
ixedSleep(maxRetries=50, sleepTime=1000 MILLISECONDS)

I am using SPARK_MAJOR_VERSION=2 and my host is a Mac OS.

Please help.

Re: HDP_2.6.4_vmware_01_02_2018_1325: spark-submit error

jsensharma — Fri, 22 Jun 2018 13:35:33 GMT

@Saurav D

Do you see any error/Warning on your Yarn logs? As we see and looks like resource manager port ?

Retrying connect to server: sandbox-hdp.hortonworks.com/<masked IP>:8032

Can we check if the port 8032 is opened and accessible?

# netstat -tnlpa | grep 8032

In Sandbox environment sometimes when we keep running the unwanted services then it creates a lots of load on the VM hence some services might not work properly sometimes. So you might want to stop some unwanted services in your sandbox and then try again.

Re: HDP_2.6.4_vmware_01_02_2018_1325: spark-submit error

askforsaurav — Fri, 22 Jun 2018 14:10:54 GMT

@Jay Kumar SenSharma, you were right: Yarn was not running. I manually started Yarn, and now the example is running fine.

Thanks very much!

Re: HDP_2.6.4_vmware_01_02_2018_1325: spark-submit error

jsensharma — Fri, 22 Jun 2018 14:14:28 GMT

@Saurav D

Good to know that it resolved your issue. If it helped then please mark this HCC thread as answered by clicking on "Accept" link on the correct answer, That way it will help other HCC users to quickly find the answers.

Re: HDP_2.6.4_vmware_01_02_2018_1325: spark-submit error

aakashmishra070 — Fri, 20 Jul 2018 16:30:29 GMT

Great article if you are in the search of the best browser for your pc with more safety and security then just click here to get mozilla firefox for windows Mac and IOS devices without any charge.