Hello everyone, in the execution of a Spark script, which invokes several applications, we have different timings in each of the runs performed, in fact it went from about 8h on 18/11/2023, to about 17h on 09/12/2023 to about 33h on 02/12/2023. Since this is a very heavy process, all daily schedules were disabled to give the application a chance to allocate all resources. The application is run sporadically during weekends, and we do not know exactly when the next run will be. We have noticed that when running Spark applications that are part of the script, a delay of about 3 to 4 hours is encountered between the execution of one job and its next. Do you have any suggestions regarding a possible cause of the anomaly encountered? Thank you ... View more