For me all spark tasks are completed successfully but the yarn application is hanged indefinitely with status as "RUNNING". And its occupying the containers and CPU VCores as well. I looked at the hive server logs and there are no errors. Even yarn applications logs does not have any error, and we are using fair scheduler with CM 5.11   I see this issue is in resolved state but no solution posted in this thread. I appreciate if there is anu fix related to this problem.   Attaching some screenshots. /Users/ntalla/Desktop/Screen Shot 2018-09-07 at 8.16.39 AM.png /Users/ntalla/Desktop/Screen Shot 2018-09-07 at 8.16.56 AM.png /Users/ntalla/Desktop/Screen Shot 2018-09-07 at 8.17.06 AM.png ... View more