2017-03-22 19:10:51,652 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0074_000001 (auth:SIMPLE) 2017-03-22 19:10:51,694 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(810)) - Start request for container_e06_1490174038938_0074_01_000001 by user guest 2017-03-22 19:10:51,695 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(850)) - Creating a new application reference for app application_1490174038938_0074 2017-03-22 19:10:51,695 INFO application.ApplicationImpl (ApplicationImpl.java:handle(464)) - Application application_1490174038938_0074 transitioned from NEW to INITING 2017-03-22 19:10:51,699 WARN logaggregation.LogAggregationService (LogAggregationService.java:verifyAndCreateRemoteLogDir(230)) - Remote Root Log Dir [/app-logs] already exist, but with incorrect permissions. Expected: [rwxrwxrwt], Found: [rwxrwxrwx]. The cluster may have problems with multiple users. 2017-03-22 19:10:51,707 INFO application.ApplicationImpl (ApplicationImpl.java:transition(304)) - Adding container_e06_1490174038938_0074_01_000001 to application application_1490174038938_0074 2017-03-22 19:10:51,707 INFO application.ApplicationImpl (ApplicationImpl.java:handle(464)) - Application application_1490174038938_0074 transitioned from INITING to RUNNING 2017-03-22 19:10:51,707 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0074_01_000001 transitioned from NEW to LOCALIZED 2017-03-22 19:10:51,707 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_INIT for appId application_1490174038938_0074 2017-03-22 19:10:51,707 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(184)) - Initializing container container_e06_1490174038938_0074_01_000001 2017-03-22 19:10:51,707 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(185)) - Initializing container container_e06_1490174038938_0074_01_000001 2017-03-22 19:10:51,729 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0074_01_000001 transitioned from LOCALIZED to RUNNING 2017-03-22 19:10:51,732 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(281)) - launchContainer: [bash, /hadoop/yarn/local/usercache/guest/appcache/application_1490174038938_0074/container_e06_1490174038938_0074_01_000001/default_container_executor.sh] 2017-03-22 19:10:54,315 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(375)) - Starting resource-monitoring for container_e06_1490174038938_0074_01_000001 2017-03-22 19:10:54,328 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 180.2 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:10:57,339 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 293.9 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:10:57,655 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:10:57,658 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(810)) - Start request for container_e06_1490174038938_0075_01_000001 by user yarn 2017-03-22 19:10:57,659 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(850)) - Creating a new application reference for app application_1490174038938_0075 2017-03-22 19:10:57,669 INFO application.ApplicationImpl (ApplicationImpl.java:handle(464)) - Application application_1490174038938_0075 transitioned from NEW to INITING 2017-03-22 19:10:57,680 INFO application.ApplicationImpl (ApplicationImpl.java:transition(304)) - Adding container_e06_1490174038938_0075_01_000001 to application application_1490174038938_0075 2017-03-22 19:10:57,681 INFO application.ApplicationImpl (ApplicationImpl.java:handle(464)) - Application application_1490174038938_0075 transitioned from INITING to RUNNING 2017-03-22 19:10:57,682 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000001 transitioned from NEW to LOCALIZING 2017-03-22 19:10:57,682 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_INIT for appId application_1490174038938_0075 2017-03-22 19:10:57,682 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(184)) - Initializing container container_e06_1490174038938_0075_01_000001 2017-03-22 19:10:57,682 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(185)) - Initializing container container_e06_1490174038938_0075_01_000001 2017-03-22 19:10:57,682 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://myserver.fr:8020/user/yarn/.staging/job_1490174038938_0075/job.splitmetainfo transitioned from INIT to DOWNLOADING 2017-03-22 19:10:57,682 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://myserver.fr:8020/user/yarn/.staging/job_1490174038938_0075/job.jar transitioned from INIT to DOWNLOADING 2017-03-22 19:10:57,682 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://myserver.fr:8020/user/yarn/.staging/job_1490174038938_0075/job.split transitioned from INIT to DOWNLOADING 2017-03-22 19:10:57,682 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://myserver.fr:8020/user/yarn/.staging/job_1490174038938_0075/job.xml transitioned from INIT to DOWNLOADING 2017-03-22 19:10:57,682 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(712)) - Created localizer for container_e06_1490174038938_0075_01_000001 2017-03-22 19:10:57,684 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1194)) - Writing credentials to the nmPrivate file /hadoop/yarn/local/nmPrivate/container_e06_1490174038938_0075_01_000001.tokens. Credentials list: 2017-03-22 19:10:57,693 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(632)) - Initializing user yarn 2017-03-22 19:10:57,695 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(126)) - Copying from /hadoop/yarn/local/nmPrivate/container_e06_1490174038938_0075_01_000001.tokens to /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000001.tokens 2017-03-22 19:10:57,695 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(133)) - Localizer CWD set to /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075 = file:/hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075 2017-03-22 19:10:57,952 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://myserver.fr:8020/user/yarn/.staging/job_1490174038938_0075/job.splitmetainfo(->/hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/filecache/10/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED 2017-03-22 19:10:57,970 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://myserver.fr:8020/user/yarn/.staging/job_1490174038938_0075/job.jar(->/hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/filecache/11/job.jar) transitioned from DOWNLOADING to LOCALIZED 2017-03-22 19:10:58,001 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://myserver.fr:8020/user/yarn/.staging/job_1490174038938_0075/job.split(->/hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED 2017-03-22 19:10:58,016 INFO localizer.LocalizedResource (LocalizedResource.java:handle(203)) - Resource hdfs://myserver.fr:8020/user/yarn/.staging/job_1490174038938_0075/job.xml(->/hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED 2017-03-22 19:10:58,017 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000001 transitioned from LOCALIZING to LOCALIZED 2017-03-22 19:10:58,036 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000001 transitioned from LOCALIZED to RUNNING 2017-03-22 19:10:58,038 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(281)) - launchContainer: [bash, /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000001/default_container_executor.sh] 2017-03-22 19:11:00,340 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(375)) - Starting resource-monitoring for container_e06_1490174038938_0075_01_000001 2017-03-22 19:11:00,353 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 42.3 MB of 512 MB physical memory used; 2.1 GB of 1.0 GB virtual memory used 2017-03-22 19:11:00,365 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 288.9 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:03,376 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 100.7 MB of 512 MB physical memory used; 2.2 GB of 1.0 GB virtual memory used 2017-03-22 19:11:03,388 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 289.1 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:06,405 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 287.5 MB of 512 MB physical memory used; 2.2 GB of 1.0 GB virtual memory used 2017-03-22 19:11:06,441 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 282.0 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:09,454 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 321.1 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:09,465 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 282.1 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:09,923 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:11:09,926 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(810)) - Start request for container_e06_1490174038938_0075_01_000002 by user yarn 2017-03-22 19:11:09,927 INFO application.ApplicationImpl (ApplicationImpl.java:transition(304)) - Adding container_e06_1490174038938_0075_01_000002 to application application_1490174038938_0075 2017-03-22 19:11:09,953 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000002 transitioned from NEW to LOCALIZING 2017-03-22 19:11:09,953 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_INIT for appId application_1490174038938_0075 2017-03-22 19:11:09,953 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(184)) - Initializing container container_e06_1490174038938_0075_01_000002 2017-03-22 19:11:09,953 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(185)) - Initializing container container_e06_1490174038938_0075_01_000002 2017-03-22 19:11:09,953 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event APPLICATION_INIT for appId application_1490174038938_0075 2017-03-22 19:11:09,953 INFO containermanager.AuxServices (AuxServices.java:handle(219)) - Got APPLICATION_INIT for service mapreduce_shuffle 2017-03-22 19:11:09,964 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(681)) - Added token for job_1490174038938_0075 2017-03-22 19:11:09,964 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000002 transitioned from LOCALIZING to LOCALIZED 2017-03-22 19:11:10,087 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000002 transitioned from LOCALIZED to RUNNING 2017-03-22 19:11:10,087 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(281)) - launchContainer: [bash, /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000002/default_container_executor.sh] 2017-03-22 19:11:12,465 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(375)) - Starting resource-monitoring for container_e06_1490174038938_0075_01_000002 2017-03-22 19:11:12,477 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 322.1 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:12,488 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61765 for container-id container_e06_1490174038938_0075_01_000002: 110.6 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:11:12,500 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 281.9 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:17,541 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 308.2 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:18,358 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61765 for container-id container_e06_1490174038938_0075_01_000002: 355.1 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:11:18,629 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 274.8 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:21,640 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 309.4 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:21,651 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61765 for container-id container_e06_1490174038938_0075_01_000002: 387.0 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:11:21,662 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 274.8 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:24,673 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 309.5 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:24,683 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61765 for container-id container_e06_1490174038938_0075_01_000002: 478.3 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:11:24,694 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 274.8 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:27,889 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 309.4 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:27,900 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61765 for container-id container_e06_1490174038938_0075_01_000002: 678.2 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:11:27,911 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 274.9 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:30,923 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 309.5 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:30,933 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61765 for container-id container_e06_1490174038938_0075_01_000002: 746.7 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:11:30,944 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 274.9 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:33,955 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 310.1 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:33,966 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61765 for container-id container_e06_1490174038938_0075_01_000002: 748.3 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:11:33,977 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 274.8 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:36,208 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:11:36,246 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(960)) - Stopping container with container Id: container_e06_1490174038938_0075_01_000002 2017-03-22 19:11:36,483 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000002 transitioned from RUNNING to KILLING 2017-03-22 19:11:36,516 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(425)) - Cleaning up container container_e06_1490174038938_0075_01_000002 2017-03-22 19:11:36,870 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(237)) - Exit code from container container_e06_1490174038938_0075_01_000002 is : 143 2017-03-22 19:11:36,995 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 311.2 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:37,010 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61765 for container-id container_e06_1490174038938_0075_01_000002: -1B of 1 GB physical memory used; -1B of 2.1 GB virtual memory used 2017-03-22 19:11:37,022 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 276.6 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:37,260 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-03-22 19:11:37,263 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000002 2017-03-22 19:11:37,263 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-03-22 19:11:37,264 INFO application.ApplicationImpl (ApplicationImpl.java:transition(347)) - Removing container_e06_1490174038938_0075_01_000002 from application application_1490174038938_0075 2017-03-22 19:11:37,264 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:startContainerLogAggregation(512)) - Considering container container_e06_1490174038938_0075_01_000002 for log-aggregation 2017-03-22 19:11:37,294 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_STOP for appId application_1490174038938_0075 2017-03-22 19:11:37,294 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(190)) - Stopping container container_e06_1490174038938_0075_01_000002 2017-03-22 19:11:37,294 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(191)) - Stopping container container_e06_1490174038938_0075_01_000002 2017-03-22 19:11:37,788 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:11:37,825 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(810)) - Start request for container_e06_1490174038938_0075_01_000003 by user yarn 2017-03-22 19:11:37,862 INFO application.ApplicationImpl (ApplicationImpl.java:transition(304)) - Adding container_e06_1490174038938_0075_01_000003 to application application_1490174038938_0075 2017-03-22 19:11:37,869 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000003 transitioned from NEW to LOCALIZING 2017-03-22 19:11:37,869 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_INIT for appId application_1490174038938_0075 2017-03-22 19:11:37,869 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(184)) - Initializing container container_e06_1490174038938_0075_01_000003 2017-03-22 19:11:37,869 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(185)) - Initializing container container_e06_1490174038938_0075_01_000003 2017-03-22 19:11:37,869 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event APPLICATION_INIT for appId application_1490174038938_0075 2017-03-22 19:11:37,869 INFO containermanager.AuxServices (AuxServices.java:handle(219)) - Got APPLICATION_INIT for service mapreduce_shuffle 2017-03-22 19:11:37,879 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(681)) - Added token for job_1490174038938_0075 2017-03-22 19:11:37,880 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000003 transitioned from LOCALIZING to LOCALIZED 2017-03-22 19:11:37,942 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000003 transitioned from LOCALIZED to RUNNING 2017-03-22 19:11:38,013 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(281)) - launchContainer: [bash, /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000003/default_container_executor.sh] 2017-03-22 19:11:39,560 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(553)) - Removed completed containers from NM context: [container_e06_1490174038938_0075_01_000002] 2017-03-22 19:11:40,022 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(375)) - Starting resource-monitoring for container_e06_1490174038938_0075_01_000003 2017-03-22 19:11:40,022 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(390)) - Stopping resource-monitoring for container_e06_1490174038938_0075_01_000002 2017-03-22 19:11:40,037 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61943 for container-id container_e06_1490174038938_0075_01_000003: 30.7 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:11:40,052 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 311.3 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:40,148 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 276.7 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:43,248 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61943 for container-id container_e06_1490174038938_0075_01_000003: 45.7 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:11:43,262 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 311.5 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:43,275 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 277.0 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:46,290 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61943 for container-id container_e06_1490174038938_0075_01_000003: 93.6 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:11:46,306 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 311.5 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:46,513 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 277.2 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:49,527 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61943 for container-id container_e06_1490174038938_0075_01_000003: 185.3 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:11:49,541 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 311.9 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:49,579 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 277.2 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:52,607 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61943 for container-id container_e06_1490174038938_0075_01_000003: 754.6 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:11:52,620 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 308.8 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:52,670 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 274.4 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:52,778 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:11:52,785 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(960)) - Stopping container with container Id: container_e06_1490174038938_0075_01_000003 2017-03-22 19:11:52,830 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000003 transitioned from RUNNING to KILLING 2017-03-22 19:11:52,830 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(425)) - Cleaning up container container_e06_1490174038938_0075_01_000003 2017-03-22 19:11:52,898 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(237)) - Exit code from container container_e06_1490174038938_0075_01_000003 is : 143 2017-03-22 19:11:53,021 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-03-22 19:11:53,021 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-03-22 19:11:53,021 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000003 2017-03-22 19:11:53,021 INFO application.ApplicationImpl (ApplicationImpl.java:transition(347)) - Removing container_e06_1490174038938_0075_01_000003 from application application_1490174038938_0075 2017-03-22 19:11:53,022 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:startContainerLogAggregation(512)) - Considering container container_e06_1490174038938_0075_01_000003 for log-aggregation 2017-03-22 19:11:53,022 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_STOP for appId application_1490174038938_0075 2017-03-22 19:11:53,022 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(190)) - Stopping container container_e06_1490174038938_0075_01_000003 2017-03-22 19:11:53,022 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(191)) - Stopping container container_e06_1490174038938_0075_01_000003 2017-03-22 19:11:53,374 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:11:53,377 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(810)) - Start request for container_e06_1490174038938_0075_01_000004 by user yarn 2017-03-22 19:11:53,378 INFO application.ApplicationImpl (ApplicationImpl.java:transition(304)) - Adding container_e06_1490174038938_0075_01_000004 to application application_1490174038938_0075 2017-03-22 19:11:53,417 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000004 transitioned from NEW to LOCALIZING 2017-03-22 19:11:53,417 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_INIT for appId application_1490174038938_0075 2017-03-22 19:11:53,417 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(184)) - Initializing container container_e06_1490174038938_0075_01_000004 2017-03-22 19:11:53,417 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(185)) - Initializing container container_e06_1490174038938_0075_01_000004 2017-03-22 19:11:53,417 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event APPLICATION_INIT for appId application_1490174038938_0075 2017-03-22 19:11:53,417 INFO containermanager.AuxServices (AuxServices.java:handle(219)) - Got APPLICATION_INIT for service mapreduce_shuffle 2017-03-22 19:11:53,418 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(681)) - Added token for job_1490174038938_0075 2017-03-22 19:11:53,418 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000004 transitioned from LOCALIZING to LOCALIZED 2017-03-22 19:11:54,708 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000004 transitioned from LOCALIZED to RUNNING 2017-03-22 19:11:54,726 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(281)) - launchContainer: [bash, /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000004/default_container_executor.sh] 2017-03-22 19:11:55,257 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(553)) - Removed completed containers from NM context: [container_e06_1490174038938_0075_01_000003] 2017-03-22 19:11:55,671 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(375)) - Starting resource-monitoring for container_e06_1490174038938_0075_01_000004 2017-03-22 19:11:55,671 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(390)) - Stopping resource-monitoring for container_e06_1490174038938_0075_01_000003 2017-03-22 19:11:55,739 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 62047 for container-id container_e06_1490174038938_0075_01_000004: 29.1 MB of 1 GB physical memory used; 2.7 GB of 2.1 GB virtual memory used 2017-03-22 19:11:55,752 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 310.6 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:55,771 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 276.3 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:11:58,784 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 62047 for container-id container_e06_1490174038938_0075_01_000004: 46.2 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:11:58,798 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 310.7 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:11:58,811 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 276.3 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:01,828 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 62047 for container-id container_e06_1490174038938_0075_01_000004: 109.3 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:12:01,845 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 310.8 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:01,858 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 276.3 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:04,117 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:04,160 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(960)) - Stopping container with container Id: container_e06_1490174038938_0075_01_000004 2017-03-22 19:12:04,179 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000004 transitioned from RUNNING to KILLING 2017-03-22 19:12:04,179 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(425)) - Cleaning up container container_e06_1490174038938_0075_01_000004 2017-03-22 19:12:04,213 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(237)) - Exit code from container container_e06_1490174038938_0075_01_000004 is : 143 2017-03-22 19:12:04,230 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-03-22 19:12:04,230 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-03-22 19:12:04,230 INFO application.ApplicationImpl (ApplicationImpl.java:transition(347)) - Removing container_e06_1490174038938_0075_01_000004 from application application_1490174038938_0075 2017-03-22 19:12:04,231 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:startContainerLogAggregation(512)) - Considering container container_e06_1490174038938_0075_01_000004 for log-aggregation 2017-03-22 19:12:04,231 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_STOP for appId application_1490174038938_0075 2017-03-22 19:12:04,231 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(190)) - Stopping container container_e06_1490174038938_0075_01_000004 2017-03-22 19:12:04,231 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(191)) - Stopping container container_e06_1490174038938_0075_01_000004 2017-03-22 19:12:04,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000004 2017-03-22 19:12:04,858 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(390)) - Stopping resource-monitoring for container_e06_1490174038938_0075_01_000004 2017-03-22 19:12:04,876 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 310.7 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:04,889 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 276.2 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:05,462 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:05,465 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(810)) - Start request for container_e06_1490174038938_0075_01_000005 by user yarn 2017-03-22 19:12:05,467 INFO application.ApplicationImpl (ApplicationImpl.java:transition(304)) - Adding container_e06_1490174038938_0075_01_000005 to application application_1490174038938_0075 2017-03-22 19:12:05,467 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000005 transitioned from NEW to LOCALIZING 2017-03-22 19:12:05,467 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_INIT for appId application_1490174038938_0075 2017-03-22 19:12:05,467 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(184)) - Initializing container container_e06_1490174038938_0075_01_000005 2017-03-22 19:12:05,467 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(185)) - Initializing container container_e06_1490174038938_0075_01_000005 2017-03-22 19:12:05,467 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event APPLICATION_INIT for appId application_1490174038938_0075 2017-03-22 19:12:05,467 INFO containermanager.AuxServices (AuxServices.java:handle(219)) - Got APPLICATION_INIT for service mapreduce_shuffle 2017-03-22 19:12:05,468 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(681)) - Added token for job_1490174038938_0075 2017-03-22 19:12:05,468 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000005 transitioned from LOCALIZING to LOCALIZED 2017-03-22 19:12:05,500 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000005 transitioned from LOCALIZED to RUNNING 2017-03-22 19:12:05,502 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(281)) - launchContainer: [bash, /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000005/default_container_executor.sh] 2017-03-22 19:12:07,455 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(553)) - Removed completed containers from NM context: [container_e06_1490174038938_0075_01_000004] 2017-03-22 19:12:07,891 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(375)) - Starting resource-monitoring for container_e06_1490174038938_0075_01_000005 2017-03-22 19:12:07,909 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 62123 for container-id container_e06_1490174038938_0075_01_000005: 140.5 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:12:07,921 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 311.0 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:07,932 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 276.7 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:09,465 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:09,469 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(960)) - Stopping container with container Id: container_e06_1490174038938_0075_01_000005 2017-03-22 19:12:09,470 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000005 transitioned from RUNNING to KILLING 2017-03-22 19:12:09,515 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(425)) - Cleaning up container container_e06_1490174038938_0075_01_000005 2017-03-22 19:12:09,558 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(237)) - Exit code from container container_e06_1490174038938_0075_01_000005 is : 143 2017-03-22 19:12:09,558 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-03-22 19:12:09,559 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000005 2017-03-22 19:12:09,560 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-03-22 19:12:09,560 INFO application.ApplicationImpl (ApplicationImpl.java:transition(347)) - Removing container_e06_1490174038938_0075_01_000005 from application application_1490174038938_0075 2017-03-22 19:12:09,560 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:startContainerLogAggregation(512)) - Considering container container_e06_1490174038938_0075_01_000005 for log-aggregation 2017-03-22 19:12:09,560 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_STOP for appId application_1490174038938_0075 2017-03-22 19:12:09,560 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(190)) - Stopping container container_e06_1490174038938_0075_01_000005 2017-03-22 19:12:09,560 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(191)) - Stopping container container_e06_1490174038938_0075_01_000005 2017-03-22 19:12:10,484 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:10,487 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(810)) - Start request for container_e06_1490174038938_0075_01_000006 by user yarn 2017-03-22 19:12:10,488 INFO application.ApplicationImpl (ApplicationImpl.java:transition(304)) - Adding container_e06_1490174038938_0075_01_000006 to application application_1490174038938_0075 2017-03-22 19:12:10,488 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000006 transitioned from NEW to LOCALIZING 2017-03-22 19:12:10,489 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_INIT for appId application_1490174038938_0075 2017-03-22 19:12:10,489 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(184)) - Initializing container container_e06_1490174038938_0075_01_000006 2017-03-22 19:12:10,489 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(185)) - Initializing container container_e06_1490174038938_0075_01_000006 2017-03-22 19:12:10,489 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event APPLICATION_INIT for appId application_1490174038938_0075 2017-03-22 19:12:10,489 INFO containermanager.AuxServices (AuxServices.java:handle(219)) - Got APPLICATION_INIT for service mapreduce_shuffle 2017-03-22 19:12:10,489 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(681)) - Added token for job_1490174038938_0075 2017-03-22 19:12:10,490 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000006 transitioned from LOCALIZING to LOCALIZED 2017-03-22 19:12:10,507 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000006 transitioned from LOCALIZED to RUNNING 2017-03-22 19:12:10,511 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(281)) - launchContainer: [bash, /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000006/default_container_executor.sh] 2017-03-22 19:12:10,932 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(375)) - Starting resource-monitoring for container_e06_1490174038938_0075_01_000006 2017-03-22 19:12:10,932 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(390)) - Stopping resource-monitoring for container_e06_1490174038938_0075_01_000005 2017-03-22 19:12:10,945 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 62192 for container-id container_e06_1490174038938_0075_01_000006: 36.8 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:12:10,956 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 311.7 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:10,968 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 276.8 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:11,576 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(553)) - Removed completed containers from NM context: [container_e06_1490174038938_0075_01_000005] 2017-03-22 19:12:13,979 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 62192 for container-id container_e06_1490174038938_0075_01_000006: 613.2 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:12:13,991 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 311.9 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:14,002 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 276.8 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:14,424 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:14,455 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(960)) - Stopping container with container Id: container_e06_1490174038938_0075_01_000006 2017-03-22 19:12:14,456 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000006 transitioned from RUNNING to KILLING 2017-03-22 19:12:14,456 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(425)) - Cleaning up container container_e06_1490174038938_0075_01_000006 2017-03-22 19:12:14,488 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(237)) - Exit code from container container_e06_1490174038938_0075_01_000006 is : 143 2017-03-22 19:12:14,503 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-03-22 19:12:14,503 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000006 2017-03-22 19:12:14,504 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-03-22 19:12:14,504 INFO application.ApplicationImpl (ApplicationImpl.java:transition(347)) - Removing container_e06_1490174038938_0075_01_000006 from application application_1490174038938_0075 2017-03-22 19:12:14,504 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:startContainerLogAggregation(512)) - Considering container container_e06_1490174038938_0075_01_000006 for log-aggregation 2017-03-22 19:12:14,504 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_STOP for appId application_1490174038938_0075 2017-03-22 19:12:14,504 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(190)) - Stopping container container_e06_1490174038938_0075_01_000006 2017-03-22 19:12:14,504 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(191)) - Stopping container container_e06_1490174038938_0075_01_000006 2017-03-22 19:12:15,498 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:15,502 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(810)) - Start request for container_e06_1490174038938_0075_01_000007 by user yarn 2017-03-22 19:12:15,503 INFO application.ApplicationImpl (ApplicationImpl.java:transition(304)) - Adding container_e06_1490174038938_0075_01_000007 to application application_1490174038938_0075 2017-03-22 19:12:15,520 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000007 transitioned from NEW to LOCALIZING 2017-03-22 19:12:15,520 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_INIT for appId application_1490174038938_0075 2017-03-22 19:12:15,520 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(184)) - Initializing container container_e06_1490174038938_0075_01_000007 2017-03-22 19:12:15,520 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(185)) - Initializing container container_e06_1490174038938_0075_01_000007 2017-03-22 19:12:15,520 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event APPLICATION_INIT for appId application_1490174038938_0075 2017-03-22 19:12:15,520 INFO containermanager.AuxServices (AuxServices.java:handle(219)) - Got APPLICATION_INIT for service mapreduce_shuffle 2017-03-22 19:12:15,522 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(681)) - Added token for job_1490174038938_0075 2017-03-22 19:12:15,523 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000007 transitioned from LOCALIZING to LOCALIZED 2017-03-22 19:12:15,543 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000007 transitioned from LOCALIZED to RUNNING 2017-03-22 19:12:15,543 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(281)) - launchContainer: [bash, /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000007/default_container_executor.sh] 2017-03-22 19:12:16,525 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(553)) - Removed completed containers from NM context: [container_e06_1490174038938_0075_01_000006] 2017-03-22 19:12:17,003 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(375)) - Starting resource-monitoring for container_e06_1490174038938_0075_01_000007 2017-03-22 19:12:17,003 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(390)) - Stopping resource-monitoring for container_e06_1490174038938_0075_01_000006 2017-03-22 19:12:17,015 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 62260 for container-id container_e06_1490174038938_0075_01_000007: 98.2 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:12:17,032 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 312.1 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:17,080 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 276.8 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:19,011 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:19,048 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(960)) - Stopping container with container Id: container_e06_1490174038938_0075_01_000007 2017-03-22 19:12:19,049 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000007 transitioned from RUNNING to KILLING 2017-03-22 19:12:19,050 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(425)) - Cleaning up container container_e06_1490174038938_0075_01_000007 2017-03-22 19:12:19,167 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(237)) - Exit code from container container_e06_1490174038938_0075_01_000007 is : 143 2017-03-22 19:12:19,177 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-03-22 19:12:19,177 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000007 2017-03-22 19:12:19,178 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-03-22 19:12:19,178 INFO application.ApplicationImpl (ApplicationImpl.java:transition(347)) - Removing container_e06_1490174038938_0075_01_000007 from application application_1490174038938_0075 2017-03-22 19:12:19,179 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:startContainerLogAggregation(512)) - Considering container container_e06_1490174038938_0075_01_000007 for log-aggregation 2017-03-22 19:12:19,179 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_STOP for appId application_1490174038938_0075 2017-03-22 19:12:19,179 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(190)) - Stopping container container_e06_1490174038938_0075_01_000007 2017-03-22 19:12:19,179 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(191)) - Stopping container container_e06_1490174038938_0075_01_000007 2017-03-22 19:12:19,508 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:19,511 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(810)) - Start request for container_e06_1490174038938_0075_01_000008 by user yarn 2017-03-22 19:12:19,512 INFO application.ApplicationImpl (ApplicationImpl.java:transition(304)) - Adding container_e06_1490174038938_0075_01_000008 to application application_1490174038938_0075 2017-03-22 19:12:19,512 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000008 transitioned from NEW to LOCALIZING 2017-03-22 19:12:19,512 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_INIT for appId application_1490174038938_0075 2017-03-22 19:12:19,513 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(184)) - Initializing container container_e06_1490174038938_0075_01_000008 2017-03-22 19:12:19,513 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(185)) - Initializing container container_e06_1490174038938_0075_01_000008 2017-03-22 19:12:19,513 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event APPLICATION_INIT for appId application_1490174038938_0075 2017-03-22 19:12:19,513 INFO containermanager.AuxServices (AuxServices.java:handle(219)) - Got APPLICATION_INIT for service mapreduce_shuffle 2017-03-22 19:12:19,514 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(681)) - Added token for job_1490174038938_0075 2017-03-22 19:12:19,514 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000008 transitioned from LOCALIZING to LOCALIZED 2017-03-22 19:12:19,551 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000008 transitioned from LOCALIZED to RUNNING 2017-03-22 19:12:19,566 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(281)) - launchContainer: [bash, /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000008/default_container_executor.sh] 2017-03-22 19:12:20,081 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(375)) - Starting resource-monitoring for container_e06_1490174038938_0075_01_000008 2017-03-22 19:12:20,081 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(390)) - Stopping resource-monitoring for container_e06_1490174038938_0075_01_000007 2017-03-22 19:12:20,096 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 62326 for container-id container_e06_1490174038938_0075_01_000008: 52.4 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:12:20,107 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 312.4 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:20,118 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 276.8 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:21,196 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(553)) - Removed completed containers from NM context: [container_e06_1490174038938_0075_01_000007] 2017-03-22 19:12:22,883 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:22,885 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(960)) - Stopping container with container Id: container_e06_1490174038938_0075_01_000008 2017-03-22 19:12:22,886 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000008 transitioned from RUNNING to KILLING 2017-03-22 19:12:22,886 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(425)) - Cleaning up container container_e06_1490174038938_0075_01_000008 2017-03-22 19:12:22,969 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(237)) - Exit code from container container_e06_1490174038938_0075_01_000008 is : 143 2017-03-22 19:12:22,976 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-03-22 19:12:22,977 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000008 2017-03-22 19:12:22,977 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-03-22 19:12:22,977 INFO application.ApplicationImpl (ApplicationImpl.java:transition(347)) - Removing container_e06_1490174038938_0075_01_000008 from application application_1490174038938_0075 2017-03-22 19:12:22,977 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:startContainerLogAggregation(512)) - Considering container container_e06_1490174038938_0075_01_000008 for log-aggregation 2017-03-22 19:12:22,977 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_STOP for appId application_1490174038938_0075 2017-03-22 19:12:22,977 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(190)) - Stopping container container_e06_1490174038938_0075_01_000008 2017-03-22 19:12:22,978 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(191)) - Stopping container container_e06_1490174038938_0075_01_000008 2017-03-22 19:12:23,118 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(390)) - Stopping resource-monitoring for container_e06_1490174038938_0075_01_000008 2017-03-22 19:12:23,130 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 312.6 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:23,141 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 277.1 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:23,536 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:23,540 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(810)) - Start request for container_e06_1490174038938_0075_01_000009 by user yarn 2017-03-22 19:12:23,542 INFO application.ApplicationImpl (ApplicationImpl.java:transition(304)) - Adding container_e06_1490174038938_0075_01_000009 to application application_1490174038938_0075 2017-03-22 19:12:23,559 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000009 transitioned from NEW to LOCALIZING 2017-03-22 19:12:23,559 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_INIT for appId application_1490174038938_0075 2017-03-22 19:12:23,559 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(184)) - Initializing container container_e06_1490174038938_0075_01_000009 2017-03-22 19:12:23,559 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(185)) - Initializing container container_e06_1490174038938_0075_01_000009 2017-03-22 19:12:23,559 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event APPLICATION_INIT for appId application_1490174038938_0075 2017-03-22 19:12:23,559 INFO containermanager.AuxServices (AuxServices.java:handle(219)) - Got APPLICATION_INIT for service mapreduce_shuffle 2017-03-22 19:12:23,560 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(681)) - Added token for job_1490174038938_0075 2017-03-22 19:12:23,560 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000009 transitioned from LOCALIZING to LOCALIZED 2017-03-22 19:12:23,590 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000009 transitioned from LOCALIZED to RUNNING 2017-03-22 19:12:23,591 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(281)) - launchContainer: [bash, /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000009/default_container_executor.sh] 2017-03-22 19:12:24,981 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(553)) - Removed completed containers from NM context: [container_e06_1490174038938_0075_01_000008] 2017-03-22 19:12:26,141 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(375)) - Starting resource-monitoring for container_e06_1490174038938_0075_01_000009 2017-03-22 19:12:26,155 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 62394 for container-id container_e06_1490174038938_0075_01_000009: 194.4 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:12:26,168 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 312.7 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:26,183 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 277.1 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:26,957 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:26,961 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(960)) - Stopping container with container Id: container_e06_1490174038938_0075_01_000009 2017-03-22 19:12:26,963 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000009 transitioned from RUNNING to KILLING 2017-03-22 19:12:26,963 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(425)) - Cleaning up container container_e06_1490174038938_0075_01_000009 2017-03-22 19:12:27,648 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(373)) - Container container_e06_1490174038938_0075_01_000009 succeeded 2017-03-22 19:12:27,677 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000009 transitioned from KILLING to EXITED_WITH_SUCCESS 2017-03-22 19:12:27,677 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000009 2017-03-22 19:12:27,678 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000009 transitioned from EXITED_WITH_SUCCESS to DONE 2017-03-22 19:12:27,678 INFO application.ApplicationImpl (ApplicationImpl.java:transition(347)) - Removing container_e06_1490174038938_0075_01_000009 from application application_1490174038938_0075 2017-03-22 19:12:27,678 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:startContainerLogAggregation(512)) - Considering container container_e06_1490174038938_0075_01_000009 for log-aggregation 2017-03-22 19:12:27,678 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_STOP for appId application_1490174038938_0075 2017-03-22 19:12:27,678 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(190)) - Stopping container container_e06_1490174038938_0075_01_000009 2017-03-22 19:12:27,678 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(191)) - Stopping container container_e06_1490174038938_0075_01_000009 2017-03-22 19:12:28,549 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:28,552 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(810)) - Start request for container_e06_1490174038938_0075_01_000010 by user yarn 2017-03-22 19:12:28,554 INFO application.ApplicationImpl (ApplicationImpl.java:transition(304)) - Adding container_e06_1490174038938_0075_01_000010 to application application_1490174038938_0075 2017-03-22 19:12:28,554 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000010 transitioned from NEW to LOCALIZING 2017-03-22 19:12:28,554 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_INIT for appId application_1490174038938_0075 2017-03-22 19:12:28,554 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(184)) - Initializing container container_e06_1490174038938_0075_01_000010 2017-03-22 19:12:28,554 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(185)) - Initializing container container_e06_1490174038938_0075_01_000010 2017-03-22 19:12:28,554 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event APPLICATION_INIT for appId application_1490174038938_0075 2017-03-22 19:12:28,554 INFO containermanager.AuxServices (AuxServices.java:handle(219)) - Got APPLICATION_INIT for service mapreduce_shuffle 2017-03-22 19:12:28,554 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(681)) - Added token for job_1490174038938_0075 2017-03-22 19:12:28,555 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000010 transitioned from LOCALIZING to LOCALIZED 2017-03-22 19:12:28,598 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000010 transitioned from LOCALIZED to RUNNING 2017-03-22 19:12:28,600 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(281)) - launchContainer: [bash, /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000010/default_container_executor.sh] 2017-03-22 19:12:29,184 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(375)) - Starting resource-monitoring for container_e06_1490174038938_0075_01_000010 2017-03-22 19:12:29,184 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(390)) - Stopping resource-monitoring for container_e06_1490174038938_0075_01_000009 2017-03-22 19:12:29,196 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 62465 for container-id container_e06_1490174038938_0075_01_000010: 78.7 MB of 1 GB physical memory used; 2.8 GB of 2.1 GB virtual memory used 2017-03-22 19:12:29,210 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 312.9 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:29,222 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 277.1 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:29,683 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(553)) - Removed completed containers from NM context: [container_e06_1490174038938_0075_01_000009] 2017-03-22 19:12:31,474 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:31,475 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(960)) - Stopping container with container Id: container_e06_1490174038938_0075_01_000010 2017-03-22 19:12:31,476 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000010 transitioned from RUNNING to KILLING 2017-03-22 19:12:31,476 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(425)) - Cleaning up container container_e06_1490174038938_0075_01_000010 2017-03-22 19:12:31,508 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(237)) - Exit code from container container_e06_1490174038938_0075_01_000010 is : 143 2017-03-22 19:12:31,511 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000010 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-03-22 19:12:31,512 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000010 2017-03-22 19:12:31,512 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000010 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-03-22 19:12:31,512 INFO application.ApplicationImpl (ApplicationImpl.java:transition(347)) - Removing container_e06_1490174038938_0075_01_000010 from application application_1490174038938_0075 2017-03-22 19:12:31,512 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:startContainerLogAggregation(512)) - Considering container container_e06_1490174038938_0075_01_000010 for log-aggregation 2017-03-22 19:12:31,512 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_STOP for appId application_1490174038938_0075 2017-03-22 19:12:31,512 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(190)) - Stopping container container_e06_1490174038938_0075_01_000010 2017-03-22 19:12:31,512 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(191)) - Stopping container container_e06_1490174038938_0075_01_000010 2017-03-22 19:12:31,567 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:31,571 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(810)) - Start request for container_e06_1490174038938_0075_01_000011 by user yarn 2017-03-22 19:12:31,573 INFO application.ApplicationImpl (ApplicationImpl.java:transition(304)) - Adding container_e06_1490174038938_0075_01_000011 to application application_1490174038938_0075 2017-03-22 19:12:31,660 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000011 transitioned from NEW to LOCALIZING 2017-03-22 19:12:31,660 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_INIT for appId application_1490174038938_0075 2017-03-22 19:12:31,660 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(184)) - Initializing container container_e06_1490174038938_0075_01_000011 2017-03-22 19:12:31,661 INFO yarn.YarnShuffleService (YarnShuffleService.java:initializeContainer(185)) - Initializing container container_e06_1490174038938_0075_01_000011 2017-03-22 19:12:31,661 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event APPLICATION_INIT for appId application_1490174038938_0075 2017-03-22 19:12:31,661 INFO containermanager.AuxServices (AuxServices.java:handle(219)) - Got APPLICATION_INIT for service mapreduce_shuffle 2017-03-22 19:12:31,661 INFO mapred.ShuffleHandler (ShuffleHandler.java:addJobToken(681)) - Added token for job_1490174038938_0075 2017-03-22 19:12:31,661 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000011 transitioned from LOCALIZING to LOCALIZED 2017-03-22 19:12:31,698 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000011 transitioned from LOCALIZED to RUNNING 2017-03-22 19:12:31,716 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:buildCommandExecutor(281)) - launchContainer: [bash, /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000011/default_container_executor.sh] 2017-03-22 19:12:32,223 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(375)) - Starting resource-monitoring for container_e06_1490174038938_0075_01_000011 2017-03-22 19:12:32,223 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(390)) - Stopping resource-monitoring for container_e06_1490174038938_0075_01_000010 2017-03-22 19:12:32,235 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 313.2 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:32,246 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 277.1 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:32,258 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 62547 for container-id container_e06_1490174038938_0075_01_000011: 81.0 MB of 1 GB physical memory used; 2.6 GB of 2.1 GB virtual memory used 2017-03-22 19:12:33,524 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(553)) - Removed completed containers from NM context: [container_e06_1490174038938_0075_01_000010] 2017-03-22 19:12:34,254 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(1108)) - Setting connection close header... 2017-03-22 19:12:34,375 INFO mapred.ShuffleHandler (ShuffleHandler.java:setResponseHeaders(1108)) - Setting connection close header... 2017-03-22 19:12:35,270 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 313.3 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:35,281 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 277.1 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:35,291 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 62547 for container-id container_e06_1490174038938_0075_01_000011: 205.5 MB of 1 GB physical memory used; 2.6 GB of 2.1 GB virtual memory used 2017-03-22 19:12:36,114 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:36,116 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(960)) - Stopping container with container Id: container_e06_1490174038938_0075_01_000011 2017-03-22 19:12:36,117 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000011 transitioned from RUNNING to KILLING 2017-03-22 19:12:36,117 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(425)) - Cleaning up container container_e06_1490174038938_0075_01_000011 2017-03-22 19:12:36,130 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(237)) - Exit code from container container_e06_1490174038938_0075_01_000011 is : 143 2017-03-22 19:12:36,144 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000011 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL 2017-03-22 19:12:36,145 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000011 2017-03-22 19:12:36,146 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000011 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE 2017-03-22 19:12:36,146 INFO application.ApplicationImpl (ApplicationImpl.java:transition(347)) - Removing container_e06_1490174038938_0075_01_000011 from application application_1490174038938_0075 2017-03-22 19:12:36,146 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:startContainerLogAggregation(512)) - Considering container container_e06_1490174038938_0075_01_000011 for log-aggregation 2017-03-22 19:12:36,147 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_STOP for appId application_1490174038938_0075 2017-03-22 19:12:36,147 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(190)) - Stopping container container_e06_1490174038938_0075_01_000011 2017-03-22 19:12:36,147 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(191)) - Stopping container container_e06_1490174038938_0075_01_000011 2017-03-22 19:12:38,292 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(390)) - Stopping resource-monitoring for container_e06_1490174038938_0075_01_000011 2017-03-22 19:12:38,303 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 314.4 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:38,314 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61520 for container-id container_e06_1490174038938_0074_01_000001: 277.1 MB of 512 MB physical memory used; 2.7 GB of 1.0 GB virtual memory used 2017-03-22 19:12:39,888 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(373)) - Container container_e06_1490174038938_0074_01_000001 succeeded 2017-03-22 19:12:39,889 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0074_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS 2017-03-22 19:12:39,889 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(425)) - Cleaning up container container_e06_1490174038938_0074_01_000001 2017-03-22 19:12:39,934 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/guest/appcache/application_1490174038938_0074/container_e06_1490174038938_0074_01_000001 2017-03-22 19:12:39,934 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0074_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE 2017-03-22 19:12:39,934 INFO application.ApplicationImpl (ApplicationImpl.java:transition(347)) - Removing container_e06_1490174038938_0074_01_000001 from application application_1490174038938_0074 2017-03-22 19:12:39,934 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:startContainerLogAggregation(512)) - Considering container container_e06_1490174038938_0074_01_000001 for log-aggregation 2017-03-22 19:12:39,934 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_STOP for appId application_1490174038938_0074 2017-03-22 19:12:39,934 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(190)) - Stopping container container_e06_1490174038938_0074_01_000001 2017-03-22 19:12:39,934 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(191)) - Stopping container container_e06_1490174038938_0074_01_000001 2017-03-22 19:12:40,939 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(553)) - Removed completed containers from NM context: [container_e06_1490174038938_0074_01_000001] 2017-03-22 19:12:40,945 INFO application.ApplicationImpl (ApplicationImpl.java:handle(464)) - Application application_1490174038938_0074 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP 2017-03-22 19:12:40,946 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event APPLICATION_STOP for appId application_1490174038938_0074 2017-03-22 19:12:40,946 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/guest/appcache/application_1490174038938_0074 2017-03-22 19:12:40,946 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopApplication(171)) - Stopping application application_1490174038938_0074 2017-03-22 19:12:40,947 INFO shuffle.ExternalShuffleBlockResolver (ExternalShuffleBlockResolver.java:applicationRemoved(206)) - Application application_1490174038938_0074 removed, cleanupLocalDirs = false 2017-03-22 19:12:40,947 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopApplication(172)) - Stopping application application_1490174038938_0074 2017-03-22 19:12:40,947 INFO shuffle.ExternalShuffleBlockResolver (ExternalShuffleBlockResolver.java:applicationRemoved(206)) - Application application_1490174038938_0074 removed, cleanupLocalDirs = false 2017-03-22 19:12:40,947 INFO application.ApplicationImpl (ApplicationImpl.java:handle(464)) - Application application_1490174038938_0074 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED 2017-03-22 19:12:40,948 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:finishLogAggregation(520)) - Application just finished : application_1490174038938_0074 2017-03-22 19:12:41,105 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:doContainerLogAggregation(567)) - Uploading logs for container container_e06_1490174038938_0074_01_000001. Current good log dirs are /hadoop/yarn/log 2017-03-22 19:12:41,150 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0074/container_e06_1490174038938_0074_01_000001/directory.info 2017-03-22 19:12:41,151 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0074/container_e06_1490174038938_0074_01_000001/launch_container.sh 2017-03-22 19:12:41,315 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(390)) - Stopping resource-monitoring for container_e06_1490174038938_0074_01_000001 2017-03-22 19:12:41,327 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(464)) - Memory usage of ProcessTree 61653 for container-id container_e06_1490174038938_0075_01_000001: 315.3 MB of 512 MB physical memory used; 2.3 GB of 1.0 GB virtual memory used 2017-03-22 19:12:41,446 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0074 2017-03-22 19:12:43,783 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(373)) - Container container_e06_1490174038938_0075_01_000001 succeeded 2017-03-22 19:12:43,783 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS 2017-03-22 19:12:43,783 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(425)) - Cleaning up container container_e06_1490174038938_0075_01_000001 2017-03-22 19:12:43,882 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075/container_e06_1490174038938_0075_01_000001 2017-03-22 19:12:43,883 INFO container.ContainerImpl (ContainerImpl.java:handle(1163)) - Container container_e06_1490174038938_0075_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE 2017-03-22 19:12:43,883 INFO application.ApplicationImpl (ApplicationImpl.java:transition(347)) - Removing container_e06_1490174038938_0075_01_000001 from application application_1490174038938_0075 2017-03-22 19:12:43,883 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:startContainerLogAggregation(512)) - Considering container container_e06_1490174038938_0075_01_000001 for log-aggregation 2017-03-22 19:12:43,884 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event CONTAINER_STOP for appId application_1490174038938_0075 2017-03-22 19:12:43,884 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(190)) - Stopping container container_e06_1490174038938_0075_01_000001 2017-03-22 19:12:43,884 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopContainer(191)) - Stopping container container_e06_1490174038938_0075_01_000001 2017-03-22 19:12:44,036 INFO ipc.Server (Server.java:saslProcess(1538)) - Auth successful for appattempt_1490174038938_0075_000001 (auth:SIMPLE) 2017-03-22 19:12:44,051 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(960)) - Stopping container with container Id: container_e06_1490174038938_0075_01_000001 2017-03-22 19:12:44,328 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:run(390)) - Stopping resource-monitoring for container_e06_1490174038938_0075_01_000001 2017-03-22 19:12:44,889 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:removeOrTrackCompletedContainersFromContext(553)) - Removed completed containers from NM context: [container_e06_1490174038938_0075_01_000001, container_e06_1490174038938_0075_01_000011] 2017-03-22 19:12:44,889 INFO application.ApplicationImpl (ApplicationImpl.java:handle(464)) - Application application_1490174038938_0075 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP 2017-03-22 19:12:44,890 INFO containermanager.AuxServices (AuxServices.java:handle(215)) - Got event APPLICATION_STOP for appId application_1490174038938_0075 2017-03-22 19:12:44,890 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(480)) - Deleting absolute path : /hadoop/yarn/local/usercache/yarn/appcache/application_1490174038938_0075 2017-03-22 19:12:44,890 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopApplication(171)) - Stopping application application_1490174038938_0075 2017-03-22 19:12:44,890 INFO shuffle.ExternalShuffleBlockResolver (ExternalShuffleBlockResolver.java:applicationRemoved(206)) - Application application_1490174038938_0075 removed, cleanupLocalDirs = false 2017-03-22 19:12:44,891 INFO yarn.YarnShuffleService (YarnShuffleService.java:stopApplication(172)) - Stopping application application_1490174038938_0075 2017-03-22 19:12:44,891 INFO shuffle.ExternalShuffleBlockResolver (ExternalShuffleBlockResolver.java:applicationRemoved(206)) - Application application_1490174038938_0075 removed, cleanupLocalDirs = false 2017-03-22 19:12:44,891 INFO application.ApplicationImpl (ApplicationImpl.java:handle(464)) - Application application_1490174038938_0075 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED 2017-03-22 19:12:44,891 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:finishLogAggregation(520)) - Application just finished : application_1490174038938_0075 2017-03-22 19:12:44,926 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:doContainerLogAggregation(567)) - Uploading logs for container container_e06_1490174038938_0075_01_000009. Current good log dirs are /hadoop/yarn/log 2017-03-22 19:12:44,949 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:doContainerLogAggregation(567)) - Uploading logs for container container_e06_1490174038938_0075_01_000010. Current good log dirs are /hadoop/yarn/log 2017-03-22 19:12:44,949 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000009/launch_container.sh 2017-03-22 19:12:44,949 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000009/stderr 2017-03-22 19:12:44,949 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000009/directory.info 2017-03-22 19:12:44,950 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000009/syslog 2017-03-22 19:12:44,950 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:doContainerLogAggregation(567)) - Uploading logs for container container_e06_1490174038938_0075_01_000007. Current good log dirs are /hadoop/yarn/log 2017-03-22 19:12:44,950 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000010/launch_container.sh 2017-03-22 19:12:44,950 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000009/stdout 2017-03-22 19:12:44,950 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000010/stderr 2017-03-22 19:12:44,950 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000010/syslog 2017-03-22 19:12:44,950 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000010/directory.info 2017-03-22 19:12:44,950 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000010/stdout 2017-03-22 19:12:44,975 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:doContainerLogAggregation(567)) - Uploading logs for container container_e06_1490174038938_0075_01_000008. Current good log dirs are /hadoop/yarn/log 2017-03-22 19:12:44,975 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000007/launch_container.sh 2017-03-22 19:12:44,976 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000007/stdout 2017-03-22 19:12:44,976 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000007/syslog 2017-03-22 19:12:44,976 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000007/directory.info 2017-03-22 19:12:44,976 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000007/stderr 2017-03-22 19:12:44,977 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:doContainerLogAggregation(567)) - Uploading logs for container container_e06_1490174038938_0075_01_000005. Current good log dirs are /hadoop/yarn/log 2017-03-22 19:12:44,977 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000008/stderr 2017-03-22 19:12:44,977 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000008/syslog 2017-03-22 19:12:44,977 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000008/directory.info 2017-03-22 19:12:44,978 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000008/launch_container.sh 2017-03-22 19:12:44,978 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000008/stdout 2017-03-22 19:12:44,979 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:doContainerLogAggregation(567)) - Uploading logs for container container_e06_1490174038938_0075_01_000006. Current good log dirs are /hadoop/yarn/log 2017-03-22 19:12:44,979 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000005/directory.info 2017-03-22 19:12:44,980 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000005/launch_container.sh 2017-03-22 19:12:44,980 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000005/syslog 2017-03-22 19:12:44,980 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000005/stdout 2017-03-22 19:12:44,980 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000005/stderr 2017-03-22 19:12:44,981 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:doContainerLogAggregation(567)) - Uploading logs for container container_e06_1490174038938_0075_01_000003. Current good log dirs are /hadoop/yarn/log 2017-03-22 19:12:44,981 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000006/stdout 2017-03-22 19:12:44,982 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000006/syslog 2017-03-22 19:12:44,982 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000006/directory.info 2017-03-22 19:12:44,982 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000006/launch_container.sh 2017-03-22 19:12:44,982 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000006/stderr 2017-03-22 19:12:44,983 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:doContainerLogAggregation(567)) - Uploading logs for container container_e06_1490174038938_0075_01_000004. Current good log dirs are /hadoop/yarn/log 2017-03-22 19:12:44,984 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000003/launch_container.sh 2017-03-22 19:12:44,984 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000003/stderr 2017-03-22 19:12:44,984 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000003/syslog 2017-03-22 19:12:44,984 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000003/directory.info 2017-03-22 19:12:44,984 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000003/stdout 2017-03-22 19:12:44,986 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:doContainerLogAggregation(567)) - Uploading logs for container container_e06_1490174038938_0075_01_000001. Current good log dirs are /hadoop/yarn/log 2017-03-22 19:12:44,986 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000004/directory.info 2017-03-22 19:12:44,986 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000004/syslog 2017-03-22 19:12:44,987 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000004/launch_container.sh 2017-03-22 19:12:44,987 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000004/stderr 2017-03-22 19:12:44,987 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000004/stdout 2017-03-22 19:12:45,117 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:doContainerLogAggregation(567)) - Uploading logs for container container_e06_1490174038938_0075_01_000002. Current good log dirs are /hadoop/yarn/log 2017-03-22 19:12:45,117 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000001/launch_container.sh 2017-03-22 19:12:45,117 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000001/stderr 2017-03-22 19:12:45,118 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000001/syslog 2017-03-22 19:12:45,118 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000001/stdout 2017-03-22 19:12:45,118 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000001/directory.info 2017-03-22 19:12:45,119 INFO logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:doContainerLogAggregation(567)) - Uploading logs for container container_e06_1490174038938_0075_01_000011. Current good log dirs are /hadoop/yarn/log 2017-03-22 19:12:45,119 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000002/stderr 2017-03-22 19:12:45,119 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000002/launch_container.sh 2017-03-22 19:12:45,119 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000002/syslog 2017-03-22 19:12:45,119 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000002/directory.info 2017-03-22 19:12:45,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000002/stdout 2017-03-22 19:12:45,121 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000011/syslog.shuffle 2017-03-22 19:12:45,121 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000011/stderr 2017-03-22 19:12:45,121 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000011/launch_container.sh 2017-03-22 19:12:45,121 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000011/stdout 2017-03-22 19:12:45,121 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000011/syslog 2017-03-22 19:12:45,122 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075/container_e06_1490174038938_0075_01_000011/directory.info 2017-03-22 19:12:45,337 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(489)) - Deleting path : /hadoop/yarn/log/application_1490174038938_0075 2017-03-22 19:13:50,014 INFO recovery.NMLeveldbStateStoreService (NMLeveldbStateStoreService.java:run(1016)) - Starting full compaction cycle 2017-03-22 19:13:50,060 INFO recovery.NMLeveldbStateStoreService$LeveldbLogger (NMLeveldbStateStoreService.java:log(1032)) - Level-0 table #358: started 2017-03-22 19:13:50,075 INFO recovery.NMLeveldbStateStoreService$LeveldbLogger (NMLeveldbStateStoreService.java:log(1032)) - Level-0 table #358: 15881 bytes OK 2017-03-22 19:13:50,090 INFO recovery.NMLeveldbStateStoreService$LeveldbLogger (NMLeveldbStateStoreService.java:log(1032)) - Delete type=0 #355 2017-03-22 19:13:50,091 INFO recovery.NMLeveldbStateStoreService$LeveldbLogger (NMLeveldbStateStoreService.java:log(1032)) - Manual compaction at level-0 from (begin) .. (end); will stop at (end) 2017-03-22 19:13:50,091 INFO recovery.NMLeveldbStateStoreService$LeveldbLogger (NMLeveldbStateStoreService.java:log(1032)) - Manual compaction at level-1 from (begin) .. (end); will stop at 'NMTokens/appattempt_1490174038938_0075_000001' @ 10040 : 1 2017-03-22 19:13:50,091 INFO recovery.NMLeveldbStateStoreService$LeveldbLogger (NMLeveldbStateStoreService.java:log(1032)) - Compacting 1@1 + 1@2 files 2017-03-22 19:13:50,107 INFO recovery.NMLeveldbStateStoreService$LeveldbLogger (NMLeveldbStateStoreService.java:log(1032)) - Generated table #359: 138 keys, 18204 bytes 2017-03-22 19:13:50,107 INFO recovery.NMLeveldbStateStoreService$LeveldbLogger (NMLeveldbStateStoreService.java:log(1032)) - Compacted 1@1 + 1@2 files => 18204 bytes 2017-03-22 19:13:50,108 INFO recovery.NMLeveldbStateStoreService$LeveldbLogger (NMLeveldbStateStoreService.java:log(1032)) - compacted to: files[ 0 0 1 0 0 0 0 ] 2017-03-22 19:13:50,109 INFO recovery.NMLeveldbStateStoreService$LeveldbLogger (NMLeveldbStateStoreService.java:log(1032)) - Delete type=2 #354 2017-03-22 19:13:50,121 INFO recovery.NMLeveldbStateStoreService$LeveldbLogger (NMLeveldbStateStoreService.java:log(1032)) - Delete type=2 #358 2017-03-22 19:13:50,121 INFO recovery.NMLeveldbStateStoreService$LeveldbLogger (NMLeveldbStateStoreService.java:log(1032)) - Manual compaction at level-1 from 'NMTokens/appattempt_1490174038938_0075_000001' @ 10040 : 1 .. (end); will stop at (end) 2017-03-22 19:13:50,121 INFO recovery.NMLeveldbStateStoreService (NMLeveldbStateStoreService.java:run(1023)) - Full compaction cycle completed in 108 msec