Created 08-16-2018 07:21 AM
Hello ,
is there any way to find our number of hive queries ran in one day ?
Actually I am looking for this because if we can find out similar queries then we can enable LLAP for them to get fast performance ? is it good idea or any other way to we can get better performance ?
Created 08-16-2018 08:02 AM
I think SmartSense Activity Analyzer would be helpful to you. Have a look through this; https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.4.5/bk_installation/content/activity_anal...
You could also see reports of the following;
• Top N Longest Running Jobs • Top N Resource Intensive Jobs • Top N Resource Wasting Jobs • Job Distribution By Type • Top N Data IO Users • CPU Usage By Queue • Job Submission Trend By Day.Hour
https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.4.5/bk_user-guide/content/mr_notebook.htm...
You can also look at TEZ view in ambari, to analyze the hive queries;
Created 08-16-2018 08:02 AM
I think SmartSense Activity Analyzer would be helpful to you. Have a look through this; https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.4.5/bk_installation/content/activity_anal...
You could also see reports of the following;
• Top N Longest Running Jobs • Top N Resource Intensive Jobs • Top N Resource Wasting Jobs • Job Distribution By Type • Top N Data IO Users • CPU Usage By Queue • Job Submission Trend By Day.Hour
https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.4.5/bk_user-guide/content/mr_notebook.htm...
You can also look at TEZ view in ambari, to analyze the hive queries;