Hi @shraddha    Could you please check by any chance if you have set master as local while creating SparkSession in your code.   Use the following sample code to run locally and cluster without updating the master value.  val appName = "MySparkApp" // Creating the SparkConf object val sparkConf = new SparkConf().setAppName(appName).setIfMissing("spark.master", "local[2]") // Creating the SparkSession object val spark: SparkSession = SparkSession.builder().config(sparkConf).getOrCreate()   Verify the whole logs once again to check is there any others errors. ... View more