As an admin of a CDH cluster ,  some query has submitted  to the hiveserver2 ,  but the query still  in the hiveserver make the explain stage , which does not submit to the yarn cluster and has no application id on yarn . And the query make the hiveserver2 wrong  which  has a too long query such as  select * from aaa where code in ('xxx','xxx1','xxx3',.......'xxx2000000') ; A sql has more than milion row  may make the hiveserver2 corrupt .    The 10002 web page  seems does not have some action button like yarn web the deal with the query .   The cdh version is 6.3.2 . hive version 2.1.1 . When this situation occur , I have to restart the hiveserver2 . I want to know if there is some way to kill a query through hive queryid or hive sessionid o instead of yarn applicationid .   It is also usefull when someone query the metastore which multithread such as "use hadoop " sql with 30 or more active connect  ,  The adminastritor has the ability to kill them forcely .    ... View more

Yarn's application priority can be found in yarn 8088 resource manager's website, How do the priority work in yarn?  Now the version of CDH I use is 6.3.2. Hadoop 3.0.0  Hive 2.1.1  I use hive on spark. Can I use the config to manage the application priority?  For some reason some hive sqls should have high application priority when those sqls are appending and run ahead of the other.  Instead of running the same time and equal share the compute resources.      When I set the following config in Hive, it seems do not work well in Yarn. MapReduce "-Dmapreduce.job.priority=xx" Flink "-yD yarn.applicaiton.priority=xx" Spark "spark.yarn.priority=xx"   In hive sql."set spark.yarn.priority=10;" It does not work ...     ... View more

hi , In the develop enviroment , there is a service named CM yarn usage aggregation runs in yarn per hour . It can be found in jobhistoryserver's  web ui . but in the test env , there is no more . The difference between this two is that develop start with root , test env start with a user with previlege sudo . how to find the starting log of CMyarnusageaggregation  to debug the problems ? The log-aggretion properties are both set to enabled. Much Thanks! ... View more