Cloudera Manger 5.8.2
Hive on Spark Completed Job got stuck on YARN.
After the hive query finished and got the result, the spark process is still running on YARN (even though when we see the the spark process in ApplicationManager it's already in COMPLETED status).
Temp solution, we have to kill the job manually or else we can't submit another spark job because YARN things the resources is still being used.
What I did is to downgrade back my cluster to CDH 5.8.0