Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark Jobserver port number ?

Spark Jobserver port number ?

New Contributor

I am using Sandbox environment on Vmware. Spark service is started on Ambari. I would like to know what would be the Spark Jobserver port number ?

I am using a third party tools where Spark Job Server url details need to be mentioned for that tool to connect with Spark.

7207-spark-preferences.png

4 REPLIES 4

Re: Spark Jobserver port number ?

Hi Madhu,

If you are trying to connect to Spark History Server, by default it runs on 18080 port:

7192-screen-shot-2016-08-31-at-52704-pm.png

If not History server, Check out the components HDP-2.5 supports here:

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/ch_introduc...

Thanks,

Jobin

Re: Spark Jobserver port number ?

New Contributor

Hi George,

Thanks for the quick response. One basic query, is Spark history-server is same as job-server ? The tool could not able to connect to Spark with port 18080.

Thanks - M.

Re: Spark Jobserver port number ?

Hi,

I am not sure if you are trying to connect to spark-sql thrift server or Rest API server. if its thrift server you can find details here:

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_spark-component-guide/content/jdbc-odbc-a...

I don't believe rest server is yet supported.

Re: Spark Jobserver port number ?

New Contributor

Hi George,

Thanks for the quick response. One basic query, is Spark history-server is same as job-server ? The tool could not able to connect to Spark with port 18080.

Thanks - M.