Support Questions

Find answers, ask questions, and share your expertise

Yarn resource utilization by specific user

avatar
Explorer

We have 2 queues and 2 user ID's assigned for each queue. Is it possible to find resources (Memory and CPU) consumed by each ID on both queues for past 1 week or month.

1 ACCEPTED SOLUTION

avatar
Super Guru
No, unless the user has its own leaf queue, which is not the case here. This a feature that everyone wants to see added.
Anyway, look at https://community.hortonworks.com/questions/13296/yarn-que-utilization-report.html to see how you can see the resource utilization for a given period per queue. One work around for you would be to create a leaf queue for each user in each parent queue. It is ugly, but it will address your needs until the expected feature is in place.
If this response is acceptable, please accept it as best answer.

View solution in original post

1 REPLY 1

avatar
Super Guru
No, unless the user has its own leaf queue, which is not the case here. This a feature that everyone wants to see added.
Anyway, look at https://community.hortonworks.com/questions/13296/yarn-que-utilization-report.html to see how you can see the resource utilization for a given period per queue. One work around for you would be to create a leaf queue for each user in each parent queue. It is ugly, but it will address your needs until the expected feature is in place.
If this response is acceptable, please accept it as best answer.