Reply
Expert Contributor
Posts: 113
Registered: ‎02-15-2016

NM memory utilization is zero

 

Hi ,

couple of NM are having this problem , containers are getting alloctaed to these NM but they are not processing 

memory utilization is also not available .

 

yarn.PNG

 

 

Champion
Posts: 776
Registered: ‎05-16-2016

Re: NM memory utilization is zero

[ Edited ]

Did you check the namenode log ? would you consider sharing it 

 Do you have HA configured ? 

is this one a standy or Active namenode 

Highlighted
Expert Contributor
Posts: 113
Registered: ‎02-15-2016

Re: NM memory utilization is zero

@csguna - this is node manager .

nodemaneger log.

physical memory used; 5.2 GB of 8.4 GB virtual memory used
May 26, 10:01:35.347 AM INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
Memory usage of ProcessTree 22059 for container-id container_1487033446961_128236_01_000409: 253.3 MB of 4 GB physical memory used; 5.2 GB of 8.4 GB virtual memory used
May 26, 10:01:35.384 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:35.395 AM INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
Memory usage of ProcessTree 15533 for container-id container_1487033446961_128184_01_1335237: 1.6 GB of 32 GB physical memory used; 28.4 GB of 67.2 GB virtual memory used
May 26, 10:01:37.023 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.024 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.030 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.030 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.054 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.368 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.368 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.368 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.368 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.368 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.369 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.369 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.369 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.369 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.369 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.369 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.369 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.369 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.370 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.370 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.370 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.370 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.369 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.370 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.369 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.370 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.370 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.371 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.371 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.371 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.371 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.371 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.371 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.372 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.372 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.372 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.372 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.373 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.373 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.373 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.372 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.375 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.376 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.377 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.378 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.379 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.384 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.444 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.519 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.524 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.525 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.525 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.525 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.525 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.525 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.526 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.526 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.526 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.526 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.529 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.530 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.530 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.530 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.530 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.531 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.534 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.534 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.537 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.540 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.544 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.546 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.548 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.558 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.588 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.589 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.591 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.591 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.591 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.593 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.594 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.600 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
May 26, 10:01:37.626 AM INFO org.apache.hadoop.mapred.ShuffleHandler
Setting connection close header...
Announcements