https://community.cloudera.com/t5/Archives-of-Support-Questions/5-8-2-1-cdh5-8-2-p0-3-Hive-on-Spark-quot-Completed-quot-Job/m-p/46000#M41738 I already downgraded my cluster to CDH 5.8.0 and I tried of what you said on the previous.<BR /><BR />Yes you are correct, event though the job is completed, when I did HoS query and didn't quit the hive shell, it's still use YARN resources.<BR /><BR />Thanks for pointing out the matter. Thu, 06 Oct 2016 13:10:33 GMT sphinxid 2016-10-06T13:10:33Z https://community.cloudera.com/t5/Archives-of-Support-Questions/5-8-2-1-cdh5-8-2-p0-3-Hive-on-Spark-quot-Completed-quot-Job/m-p/45558#M41735 <P>Cloudera Manger 5.8.2</P><P>CDH&nbsp;5.8.2-1.cdh5.8.2.p0.3</P><P>&nbsp;</P><P>Hive on Spark Completed Job got stuck on YARN.</P><P>&nbsp;</P><P>After&nbsp;the hive query finished and got the result, the spark process is still running on YARN (even though when we see the the spark process in ApplicationManager it's already in COMPLETED status).</P><P>Temp solution, we have to kill the job manually or else we can't submit another spark job because&nbsp;YARN things the resources is still being used.</P><P>&nbsp;</P><P>What I did is to downgrade back my cluster to CDH 5.8.0</P> Fri, 16 Sep 2022 10:41:05 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/5-8-2-1-cdh5-8-2-p0-3-Hive-on-Spark-quot-Completed-quot-Job/m-p/45558#M41735 sphinxid 2022-09-16T10:41:05Z https://community.cloudera.com/t5/Archives-of-Support-Questions/5-8-2-1-cdh5-8-2-p0-3-Hive-on-Spark-quot-Completed-quot-Job/m-p/45578#M41736 Is this issue specific to CDH5.9? What is he behavior on CDH5.8.<BR /><BR />AFAIK, this is the expected behavior. The HoS application on yarn keeps running even after the query result is running. This application on yarn is treated as a container to run future queries. Starting a new container is an expensive operation. Having them warmed up speeds up the execution of future queries. You should observe that the next queries are noticeably faster.<BR /><BR />Please provide us additional info on the behavior in CDH5.8, so we can further assist you. Thanks Mon, 26 Sep 2016 12:55:48 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/5-8-2-1-cdh5-8-2-p0-3-Hive-on-Spark-quot-Completed-quot-Job/m-p/45578#M41736 NaveenGangam 2016-09-26T12:55:48Z https://community.cloudera.com/t5/Archives-of-Support-Questions/5-8-2-1-cdh5-8-2-p0-3-Hive-on-Spark-quot-Completed-quot-Job/m-p/45970#M41737 Could you please post an update so we can determine if there is a regression or not? Thanks Wed, 05 Oct 2016 20:12:45 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/5-8-2-1-cdh5-8-2-p0-3-Hive-on-Spark-quot-Completed-quot-Job/m-p/45970#M41737 NaveenGangam 2016-10-05T20:12:45Z https://community.cloudera.com/t5/Archives-of-Support-Questions/5-8-2-1-cdh5-8-2-p0-3-Hive-on-Spark-quot-Completed-quot-Job/m-p/46000#M41738 I already downgraded my cluster to CDH 5.8.0 and I tried of what you said on the previous.<BR /><BR />Yes you are correct, event though the job is completed, when I did HoS query and didn't quit the hive shell, it's still use YARN resources.<BR /><BR />Thanks for pointing out the matter. Thu, 06 Oct 2016 13:10:33 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/5-8-2-1-cdh5-8-2-p0-3-Hive-on-Spark-quot-Completed-quot-Job/m-p/46000#M41738 sphinxid 2016-10-06T13:10:33Z https://community.cloudera.com/t5/Archives-of-Support-Questions/5-8-2-1-cdh5-8-2-p0-3-Hive-on-Spark-quot-Completed-quot-Job/m-p/46006#M41739 Awesome !! Thanks for the update. Thu, 06 Oct 2016 15:10:44 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/5-8-2-1-cdh5-8-2-p0-3-Hive-on-Spark-quot-Completed-quot-Job/m-p/46006#M41739 NaveenGangam 2016-10-06T15:10:44Z