Hello! I`m newbie in spark and all cloud-data workflow, but I have a problem on my new job where I need to work with PySpark and Hadoop. In my spark-history some applications are "incompleted" for week now. I've tried to kill them, close sparkContext(), kill main .py process, but nothing helped. For example,      yarn application -status <id>     shows:     ... State: FINISHED Final-State: SUCCEDED ... Log Aggregation Status: TIME_OUT ...     But in Spark-History I still see it in incomplete section of my applications. If I open this application there, I can see 1 Active job with 1 Alive executor, but they are doing nothing for all week. This seems like a logging bug, but as I know this problem is only with me, other coworkers doesn't have this problem. This thread doesn't helped me, because I dont have access to start-history-server.sh. I suppose this is because of      Log Aggregation Status: TIME_OUT     because my "completed" applications have     Log Aggregation Status: SUCCEDED     What can I do to fix this? Right now I have 80+ incompleted applications in spark-history... Sorry, for my bad English 😞 ... View more