question Re: how to know who eat yarn memory in Support Questions

how to know who eat yarn memory

mike_bronson7 — Wed, 25 Oct 2017 18:02:01 GMT

how to know who eat yarn memory ?

I ask because we have exactly two ambari cluster

on one ambari cluster yarn memory is almost 100%

on the second yarn memory is 50%

so how to know who eat the yarn memory on the first cluster?

Re: how to know who eat yarn memory

sshridhar — Sun, 18 Aug 2019 01:14:47 GMT

@uri ben-ari

You can check it from YARN Resource Manager UI (RM UI).

From Ambari YARN page, open RM UI

From RM UI, you can have a look at the application which are running under YARN. From there you can look into memory consumption by each application, and compare your clusters for discrepancy.

RM UI showing list of apps (with Allocated Memory).

You can click on a specific app to have a detailed look on queue and memory used.

Re: how to know who eat yarn memory

mike_bronson7 — Thu, 26 Oct 2017 02:19:01 GMT

thx for this details , I opened the page and I see many spark app opened , so do you think if I will restart the spark it will solved this isshue

Re: how to know who eat yarn memory

sshridhar — Thu, 26 Oct 2017 02:31:32 GMT

I belive you need to figure why multiple Spark apps are running. If this is not a production cluster, and no one is going to get affected out of restarting SPARK, you can look into that option.

But this just makes me to believe that the configuration settings for SPARK on how many SPARK apps are supposed to run is most probably the difference between two of your clusters.

I am not an expert in SPARK to point you to the correct config to look for.