Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Unable to spark-submit from SSH (Sandbox VMware)

Unable to spark-submit from SSH (Sandbox VMware)

I downloaded Sanbox 2.5 for VMware to submit Spark processes following the guide: http://hortonworks.com/hadoop-tutorial/a-lap-around-apache-spark/.

When i SSH into the machine i found the following are missing: *) /usr/hdp/current/spark-client *) "su spark" gives "su: user spark does not exist" *) "java" returns "-bash: java: command not found"

What am i missing to do? Please note the Zeppelin Notebook works. Could you please help me to start the spark shell and / or sumbit job with spark-submit?

The same procedure on VirtualBox is working well and seems everything already installed.

Thanks

Alessandro

2 REPLIES 2
Highlighted

Re: Unable to spark-submit from SSH (Sandbox VMware)

Rising Star

@Alessandro Lulli

Hello, you are probably logged into the vmware host that is running the sandbox docker container instead of the sandbox docker container itself. The port forwarding is now 2222 for the sandbox on both vmware and virtualbox; alternatively you can point your browser to http://ip:4200 to login.

Highlighted

Re: Unable to spark-submit from SSH (Sandbox VMware)

Hello and thanks,

logging through the port 2222 solved the issue.

Don't have an account?
Coming from Hortonworks? Activate your account here