Reply
Explorer
Posts: 30
Registered: ‎07-06-2018

YARN resource pool utilization

Is there a way to get exact amount of memory being used by a tenant /user /job in a resource pool OR the total memory or vcores consumed/used in a resource pool.

If it's a possibility looking to get this via cm api or any other way. Is there a way to capture ifnormation available via YARN RM UI, it shows for each pool what is the used amount of memory and what is available?

 

I know CM utilization exposes similar information, but it all gets displayed as average utilization. Is it advisable to use that information to do further calculation.

(Looking at below, it may not be the case )

https://community.cloudera.com/t5/Cloudera-Manager-Installation/CPU-and-Memory-Usage-per-job-perspec...

 

Please suggest.

 

 

Regards

Explorer
Posts: 30
Registered: ‎07-06-2018

Re: YARN resource pool utilization

Additionally it would be great if there is a way to get running job's memory/vcores utilization somewhere from CM or any other way.

 

Regards

Announcements