https://community.cloudera.com/t5/Support-Questions/Spark-port-binding-issue/m-p/87661#M21510 Hi Naveen,<BR /><BR />If you have limited number of ports available. You can assign port for each application.<BR /><BR />--conf "spark.driver.port=4050"<BR />—conf "spark.executor.port=51001"<BR />--conf "spark.ui.port=4005"<BR /><BR />Hope it helps<BR /><BR />Thanks<BR />Jerry Tue, 12 Mar 2019 16:26:36 GMT Jerry 2019-03-12T16:26:36Z https://community.cloudera.com/t5/Support-Questions/Spark-port-binding-issue/m-p/87491#M21509 <P>We are getting below errors when 15 or 16 spark jobs are running parallelly. We are having a 21 node cluster and running spark on yarn. Regardless of the number of nodes in the cluster does one cluster get to use only 17 ports or is it 17 ports per node in a cluster? How to avoid this when we run 50 or 100 spark jobs parallely?</P><P>&nbsp;</P><P>WARN util.Utils: Service ‘SparkUI’ could not bind on port 4040. Attempting port 4041.</P><P>:::::</P><P>WARN util.Utils: Service ‘SparkUI’ could not bind on port 4055. Attempting port 4056.</P><P>Address alredy in use: Service ‘sparkUI’ failed after 16 retries! Consider explicitly setting the appropriate port for the service ‘SparkUI</P> Fri, 16 Sep 2022 14:13:09 GMT https://community.cloudera.com/t5/Support-Questions/Spark-port-binding-issue/m-p/87491#M21509 naveen1 2022-09-16T14:13:09Z https://community.cloudera.com/t5/Support-Questions/Spark-port-binding-issue/m-p/87661#M21510 Hi Naveen,<BR /><BR />If you have limited number of ports available. You can assign port for each application.<BR /><BR />--conf "spark.driver.port=4050"<BR />—conf "spark.executor.port=51001"<BR />--conf "spark.ui.port=4005"<BR /><BR />Hope it helps<BR /><BR />Thanks<BR />Jerry Tue, 12 Mar 2019 16:26:36 GMT https://community.cloudera.com/t5/Support-Questions/Spark-port-binding-issue/m-p/87661#M21510 Jerry 2019-03-12T16:26:36Z