- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
how much resource a yarn application requests Resource Manager to run?
- Labels:
-
Apache YARN
-
Cloudera Manager
Created ‎09-06-2018 09:23 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
When a yarn application is about to run, it needs to send a request for the container allocation. How does it know that it needs certain amount of resource to run in certain amount of time. How do I get that by REST api?
Created ‎09-07-2018 05:09 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The amount of resource a Yarn application will request is completely dependent on the type of Application. For MapReduce, it is generally based on the inputsplit/no. of reducers configured and the memory/vcores configured per mapper/reducer in the JobConf.
To check how much Resources are currently being used by a single application, you can use the following Rest API and check the fields "allocatedMB","allocatedVCores" and "runningContainers"
GET http://<rm http address:port>/ws/v1/cluster/apps/<applicationId>
