question Re: Get metrics for a specific queue in Archives of Support Questions (Read Only)

Get metrics for a specific queue

luis_size1 — Tue, 15 Mar 2016 22:48:42 GMT

Hello,

I am studying the list of available metrics in Ambari here: here

Some metrics looks like related to root queue : "yarn.QueueMetrics.Queue=root.AvailableMB"

How can I get the same metrics for a specific queue ? ex. marketing queue ?

Thanks

Re: Get metrics for a specific queue

aervits — Tue, 15 Mar 2016 23:07:55 GMT

you'd use the marketing in the name to look at specific queue utilization i.e.

yarn.scheduler.capacity.root.Marketing.Advertising.acl_administer_jobs=*
yarn.scheduler.capacity.root.Marketing.Advertising.acl_administer_queue=*
yarn.scheduler.capacity.root.Marketing.Advertising.acl_submit_applications=*
yarn.scheduler.capacity.root.Marketing.Advertising.capacity=30
yarn.scheduler.capacity.root.Marketing.Advertising.maximum-capacity=40
yarn.scheduler.capacity.root.Marketing.Advertising.state=STOPPED
yarn.scheduler.capacity.root.Marketing.Advertising.user-limit-factor=1
yarn.scheduler.capacity.root.Marketing.Sales.acl_administer_jobs=*
yarn.scheduler.capacity.root.Marketing.Sales.acl_administer_queue=*
yarn.scheduler.capacity.root.Marketing.Sales.acl_submit_applications=*
yarn.scheduler.capacity.root.Marketing.Sales.capacity=70
yarn.scheduler.capacity.root.Marketing.Sales.maximum-capacity=80
yarn.scheduler.capacity.root.Marketing.Sales.minimum-user-limit-percent=20
yarn.scheduler.capacity.root.Marketing.Sales.state=RUNNING
yarn.scheduler.capacity.root.Marketing.Sales.user-limit-factor=1
yarn.scheduler.capacity.root.Marketing.acl_administer_jobs=*
yarn.scheduler.capacity.root.Marketing.acl_submit_applications=*
yarn.scheduler.capacity.root.Marketing.capacity=10
yarn.scheduler.capacity.root.Marketing.maximum-capacity=40
yarn.scheduler.capacity.root.Marketing.queues=Sales,Advertising
yarn.scheduler.capacity.root.Marketing.state=RUNNING
yarn.scheduler.capacity.root.Marketing.user-limit-factor=1

http://hortonworks.com/hadoop-tutorial/configuring-yarn-capacity-scheduler-ambari/

Re: Get metrics for a specific queue

aervits — Tue, 15 Mar 2016 23:09:22 GMT

here's our document on setting up queues http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_yarn_resource_mgt/content/ch_capacity_scheduler.html

Re: Get metrics for a specific queue

2rajukv — Fri, 09 Sep 2016 02:45:59 GMT

Hi Luis

If you are using Ambari 2.2.2 and above version. Then it comes with a service grafana. Grafana has the option to create dash board using AMS (Ambari metrics)..

https://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.0/bk_Ambari_Users_Guide/content/_grafana_yarn_NodeManagers.html

I found this github, yet to be tried how it works.

https://github.com/prajwalrao/ambari-metrics-grafana/blob/master/README.md

Note: Don't forget to vote

Re: Get metrics for a specific queue

2rajukv — Fri, 09 Sep 2016 02:49:41 GMT

Correction @Luis Size hortonworks link for the yarn queue is

https://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.0/bk_Ambari_Users_Guide/content/_grafana_yarn_queues.html