Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

YARN Capacity Scheduler Queue utilisation graph.

avatar
Super Collaborator

Is there any tool which will give Queue utilisation(memory, cores) graph?

I want historical data in graphical representation, so that I can adjust my workload(reschedule jobs) as per resource utilization trend over time.

1 ACCEPTED SOLUTION

avatar
Rising Star
@Rahul Pathak

I guess Grafana with Ambari can help on this. Please use link to setup and configure Grafana.

Once Grafana is accessible, design your dashboard. Below are few sample screenshots:

855-04.png

856-05.png

View solution in original post

14 REPLIES 14

avatar
Master Mentor

@Rahul Pathak That will be RM UI, You can see all the jobs running and using different queues.

Click Yarn in ambari --> Quick links

avatar
Super Collaborator

I want historical data in graphical representation, so that I can adjust my workload(reschedule jobs) as per resource utilization trend over time.

avatar
Master Mentor

@Rahul Pathak You are looking for something like this

avatar
Super Collaborator

@Neeraj Sabharwal I need something like this. But working on real data.

avatar
Rising Star
@Rahul Pathak

I guess Grafana with Ambari can help on this. Please use link to setup and configure Grafana.

Once Grafana is accessible, design your dashboard. Below are few sample screenshots:

855-04.png

856-05.png

avatar
Super Collaborator

Thanks.

I will check and let you know.

avatar
Super Collaborator

It is working fine. Thanks once again.

However I guess this is not available for ambari without ambari metrics collector.

Is there way to achieve this for Ambari Version1.5.1.110

avatar
Rising Star

For Ambari 1.5, Am not sure which fits this requirement. Will let you know, If I find anything.

avatar
Guru

@Rahul Pathak @Neeraj Sabharwal : I am trying to configure grafan with ambari and trying to create graph but it is throwing me an error. So can you please point me to solution.

Problem! The requested resource doesn't exist: ServiceComponentHost not found, clusterName=HDPTST, serviceName=AMBARI_METRICS, serviceComponentName=METRICS_COLLECTOR, hostName=test.com