question Re: Yarn Que Utilization Report in Archives of Support Questions (Read Only)

Yarn Que Utilization Report

sunile_manjee — Wed, 03 Feb 2016 02:26:51 GMT

Via ambari or resource manager UI I need to determine how a yarn queue is utilizing resources (CPU, Ram, disk, etc) for any given time period. If a job is running it can easily tell how the que is doing. However if i want to go back 2 weeks or 2 months, how can I do this?

Re: Yarn Que Utilization Report

aervits — Wed, 03 Feb 2016 02:31:29 GMT

@Sunile Manjee there's LinkedIn rewinder Link and engineering had mentioned we have something the works for future release but nothing outside the box now

Re: Yarn Que Utilization Report

nsabharwal — Wed, 03 Feb 2016 04:44:14 GMT

@Sunile Manjee

This project looks really impressive. BTW, Great question and there is a chance that I may open it as enhancement request. https://github.com/linkedin/gobblin/wiki/Job%20Execution%20History%20Store

Re: Yarn Que Utilization Report

sunile_manjee — Wed, 03 Feb 2016 11:43:45 GMT

I found a solution through ambari 2.2.1 which works well. Using the widgets I select AM-resources-used / AM resource available. bam! there you go. you have your que utilization.

Re: Yarn Que Utilization Report

nsabharwal — Wed, 03 Feb 2016 12:52:36 GMT

Hi @Sunile Manjee

If you could publish an article on this then it will be very helpful.

Re: Yarn Que Utilization Report

sunile_manjee — Wed, 03 Feb 2016 12:56:23 GMT

Not a bad idea. Let me work on it.

Re: Yarn Que Utilization Report

sunile_manjee — Mon, 19 Aug 2019 10:25:38 GMT

@Neeraj Sabharwal

I created a widget to do this:

and then I added this widget to my yarn page.

You can view the utilization by time using the drop down:

Re: Yarn Que Utilization Report

nsabharwal — Thu, 11 Feb 2016 04:16:05 GMT

@Sunile Manjee Do you have access to create articles?

Re: Yarn Que Utilization Report

sunile_manjee — Thu, 11 Feb 2016 04:42:57 GMT

@Neeraj Sabharwal

Yes I do. You think it is better off as a article?

Re: Yarn Que Utilization Report

nsabharwal — Thu, 11 Feb 2016 04:44:20 GMT

@Sunile Manjee Yeah, Boss 🙂 You get 15 points for articles and we can reference your article to other users in future posts. I see that you have lots of great answers so I do recommend to post articles.

Re: Yarn Que Utilization Report

sunile_manjee — Thu, 11 Feb 2016 04:53:23 GMT

done.

https://community.hortonworks.com/articles/16151/yarn-que-utilization-ambari-widget.html