Created 12-09-2015 02:38 PM
Is there any tool which will give Queue utilisation(memory, cores) graph?
I want historical data in graphical representation, so that I can adjust my workload(reschedule jobs) as per resource utilization trend over time.
Created on 12-16-2015 04:42 AM - edited 08-19-2019 05:43 AM
I guess Grafana with Ambari can help on this. Please use link to setup and configure Grafana.
Once Grafana is accessible, design your dashboard. Below are few sample screenshots:
Created 02-10-2016 12:59 PM
Created on 02-10-2016 01:04 PM - edited 08-19-2019 05:42 AM
Created 02-10-2016 01:16 PM
What is your ambari and HDP version. Try generating graph for some other component like Resourcemanager. Also try deleting stale hosts/services from ambari.
Created on 02-10-2016 01:44 PM - edited 08-19-2019 05:42 AM
I have ambari Version2.2.0.0 and hdp stack 2.3.4.0.
I tried for other metrics for Resourcemanager but getting some weird error.
Problem! Unable to compile query predicate: Invalid Query Token: token='(', previous token type=VALUE_OPERAND.
Created 02-11-2016 02:14 PM
Metrics for which you are trying to generate the graph needs to be edited manually.
Enter "metrics/yarn/Queue/root/AvailableMB" in metric box while selecting Resourcemanager
Similarly for child queue of root viz child1 you have to enter metrics/yarn/Queue/root/child1/AvailableMB
I have tested this on ambari Version 2.2.0.0 with hdp stack 2.3.4.0.