Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark Port Clients in CDH5

Highlighted

Spark Port Clients in CDH5

New Contributor

I am running the Spark client in the CDH5 packages for Ubuntu 12.04. Unfortunately, the version of Spark for CDH5 is 1.0.0, which does not appear to have a configuration directive for all of the ports that the Spark client uses, only the Driver port (it appears that it selects these ports at random upon start up).

 

The latest version of Spark 1.1.0 seems to have configuration directives for all of the ports.

 

 

Is there any other way to set these ports outside of the official configuration? Or is there a way to upgrade Spark to 1.1.0 within CDH?

1 REPLY 1
Highlighted

Re: Spark Port Clients in CDH5

New Contributor

The subject of this thread should have read: Spark Client Ports in CDH5

Don't have an account?
Coming from Hortonworks? Activate your account here