Hello,   You try 'spark.scheduler.mode' as 'FAIR'   conf.set("spark.scheduler.mode", "FAIR")  so that multiple job will be executed in parallel.   Please refer document [1]   [1] https://spark.apache.org/docs/latest/job-scheduling.html#scheduling-within-an-application ... View more