Support Questions

Find answers, ask questions, and share your expertise
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

View resources allocated to particular application in Cloudera Manager




Is there a way to view the resources allocated to a particular yarn application while it is running?


The issue I am trying to determine is why my spark application decides to shut down the spark context.


I've greped the yarn logs for exceptions and I didn't find any memory related issues.



The RM UI and the Spark History are what you are looking for.  The yarn command can also be used in a pinch.

Can you point me to particular documentation?

Ideally it would the same output at Ganglia where you can view I/O, memory, disk for each machine in use.


This is old but still useful.

I know you can get the info from the RM UI. You should be able to get it from the Spark History UI through curl commands as well. The information could then be fed into Ganglia.
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.