https://community.cloudera.com/t5/Support-Questions/How-to-know-which-Node-is-Driver-Node-which-Node-is-Worker/m-p/367297#M239859 <P>Hi&nbsp;<a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/102287">@quangbilly79</a>&nbsp;</P><P>&nbsp;</P><P>Cloudera will support YARN and Kubernets deployment mode and it will not support Standalone mode (In standalone mode you can access the Spark Master using 7077 port).</P><P>&nbsp;</P><P>In order to check which node driver is launched and which node is executor is launched you need to go to Spark UI or Spark History Server UI of that application. From there go to Executors tab. You can see list of executors.</P><P>&nbsp;</P><P>In the second table you find executor id. Where the executor id is 'driver' that is the one Driver Node and remaining all are executors.</P> Thu, 30 Mar 2023 11:31:58 GMT RangaReddy 2023-03-30T11:31:58Z https://community.cloudera.com/t5/Support-Questions/How-to-know-which-Node-is-Driver-Node-which-Node-is-Worker/m-p/362879#M238858 <P>I'm using a tool in which I have to point out the master node (driver node) of the Cloudera Spark Cluster (<STRONG>spark :// &lt;some-spark-master&gt; : 7077).<SPAN>&nbsp;</SPAN></STRONG>Also as I learned, Spark has "Master Node", "Driver Node" and "Worker Nodes".</P><P>So I decided to go to the Cloudera Web Manager and checked the Configuration Tab of the Spark service, but all I found are "<STRONG>Gateway instance"</STRONG> and "<STRONG>History Server instance</STRONG>". Where are the "<STRONG>Driver instance"</STRONG> and "<STRONG>Worker instance</STRONG>"? I can't add these two instances in the "<STRONG>Add Role Instances</STRONG>" too</P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="quangbilly79_0-1675302416028.png" style="width: 400px;"><img src="https://community.cloudera.com/t5/image/serverpage/image-id/36705i65B500E13D64EEDC/image-size/medium?v=v2&amp;px=400" role="button" title="quangbilly79_0-1675302416028.png" alt="quangbilly79_0-1675302416028.png" /></span></P><P>&nbsp;</P><P>&nbsp;</P><P>My guess is that it's in Yarn service configuration, but I can't find anything related to "Master", "Driver" or "Worker" either.</P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="quangbilly79_1-1675302416366.png" style="width: 400px;"><img src="https://community.cloudera.com/t5/image/serverpage/image-id/36706i009947BA18D9B7C7/image-size/medium?v=v2&amp;px=400" role="button" title="quangbilly79_1-1675302416366.png" alt="quangbilly79_1-1675302416366.png" /></span></P><P>&nbsp;</P><P>&nbsp;</P><P>So what is the link to "Spark Master" that ends with 7077 (what is the Node)? I can't find it anywhere in the Configuration tab</P> Thu, 02 Feb 2023 01:49:09 GMT https://community.cloudera.com/t5/Support-Questions/How-to-know-which-Node-is-Driver-Node-which-Node-is-Worker/m-p/362879#M238858 quangbilly79 2023-02-02T01:49:09Z https://community.cloudera.com/t5/Support-Questions/How-to-know-which-Node-is-Driver-Node-which-Node-is-Worker/m-p/367297#M239859 <P>Hi&nbsp;<a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/102287">@quangbilly79</a>&nbsp;</P><P>&nbsp;</P><P>Cloudera will support YARN and Kubernets deployment mode and it will not support Standalone mode (In standalone mode you can access the Spark Master using 7077 port).</P><P>&nbsp;</P><P>In order to check which node driver is launched and which node is executor is launched you need to go to Spark UI or Spark History Server UI of that application. From there go to Executors tab. You can see list of executors.</P><P>&nbsp;</P><P>In the second table you find executor id. Where the executor id is 'driver' that is the one Driver Node and remaining all are executors.</P> Thu, 30 Mar 2023 11:31:58 GMT https://community.cloudera.com/t5/Support-Questions/How-to-know-which-Node-is-Driver-Node-which-Node-is-Worker/m-p/367297#M239859 RangaReddy 2023-03-30T11:31:58Z