https://community.cloudera.com/t5/Support-Questions/Spark3-Issue-Executor-is-not-able-to-register-with-the/m-p/403474#M252077 <P>Can you try disabling the spark.authentication ?&nbsp;</P><P>&nbsp;</P><P><SPAN>spark.authenticate = false</SPAN></P> Tue, 04 Mar 2025 07:40:27 GMT cloude 2025-03-04T07:40:27Z https://community.cloudera.com/t5/Support-Questions/Spark3-Issue-Executor-is-not-able-to-register-with-the/m-p/403238#M251975 <P>HI Guys,&nbsp;</P><P>I am having an issue running an Spark 3 jobs:&nbsp;</P><P>Driver log:&nbsp;<BR />ERROR: cluster:YarnClusterScheduler: [dispatcher-CoarseGrainedScheduler] : Lost executor 1 on host_name: Unable to create executor due to unable to register with external shuffle service due to: java.lang.IllegalException: Unknown message type: -22</P><P>Executor log:&nbsp;<BR />ERROR: Exception while bootstrapping client in 3 ms.&nbsp;<BR />Java.lang.RuntimeException:&nbsp;java.lang.IllegalException: Unknown message type: -22</P><P>Executor making 3 attempts with 5 second waiting period, then exiting.&nbsp;</P><P>From my research, I found recommendation on increasing the shuffle register timeout. Any recommendation is appreciated.&nbsp;</P> Fri, 28 Feb 2025 16:24:56 GMT https://community.cloudera.com/t5/Support-Questions/Spark3-Issue-Executor-is-not-able-to-register-with-the/m-p/403238#M251975 SalmanM 2025-02-28T16:24:56Z https://community.cloudera.com/t5/Support-Questions/Spark3-Issue-Executor-is-not-able-to-register-with-the/m-p/403474#M252077 <P>Can you try disabling the spark.authentication ?&nbsp;</P><P>&nbsp;</P><P><SPAN>spark.authenticate = false</SPAN></P> Tue, 04 Mar 2025 07:40:27 GMT https://community.cloudera.com/t5/Support-Questions/Spark3-Issue-Executor-is-not-able-to-register-with-the/m-p/403474#M252077 cloude 2025-03-04T07:40:27Z