Created on 09-25-2016 09:20 AM - edited 09-16-2022 03:41 AM
Cloudera Manger 5.8.2
Hive on Spark Completed Job got stuck on YARN.
After the hive query finished and got the result, the spark process is still running on YARN (even though when we see the the spark process in ApplicationManager it's already in COMPLETED status).
Temp solution, we have to kill the job manually or else we can't submit another spark job because YARN things the resources is still being used.
What I did is to downgrade back my cluster to CDH 5.8.0
Created 10-05-2016 01:12 PM
Created 10-06-2016 06:10 AM
Created 10-06-2016 08:10 AM