- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Yarn container size
- Labels:
-
Apache YARN
Created ‎07-12-2016 07:02 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
let me know the command to check the container size using terminal
Created ‎07-12-2016 08:13 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
yarn application -status {Application ID} command returns "Aggregate Resource Allocation" in terms of "MB-seconds" and "vcore-seconds" For e.g. -status for one of my applications returned: Aggregate Resource Allocation : 12865641 MB-seconds, 1041 vcore-seconds
Created ‎07-12-2016 08:13 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
yarn application -status {Application ID} command returns "Aggregate Resource Allocation" in terms of "MB-seconds" and "vcore-seconds" For e.g. -status for one of my applications returned: Aggregate Resource Allocation : 12865641 MB-seconds, 1041 vcore-seconds
Created ‎07-14-2016 03:59 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Are you referring to Hive/Tez job container sizes ? If yes, you can go to hive CLI and try
set hive.tez.container.size;
or if it a mapreduce job , you can try the same set command for mapreduce mapper or reducer mb.memory properties.
if it is a generic YARN container size for any particular YARN application, then the containers are JVM processes, you can use yarn application commands to get the application attempt id and using the application attempt id, you can list the containers running for that APP. Doing a ps aux | grep <container pid> should give you enough details about the container size.
