@Narahari Looking at the logs seems the connection issue.    As the container failed with below error:  [2020-12-06 15:49:09.305]Container exited with a non-zero exit code 10. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : And then tracing it further:    [ERROR]: org.apache.spark.SparkContext - Error initializing SparkContext. org.apache.spark.SparkException: Yarn application has already ended! It might have been killed or unable to launch application master.  Leads us this channel bind exception.   [ERROR]: org.apache.spark.network.client.TransportClient - Failed to send RPC 6049494344693001682 to /10.4.37.168:42590: java.nio.channels.ClosedChannelException java.nio.channels.ClosedChannelException So perhaps you have to check if things are connecting to 10.4.37.168:42590 and then see from there.  ... View more