Log Type: syslog Log Upload Time: Mon Feb 15 11:46:27 -0500 2016 Log Length: 110758 2016-02-15 11:18:50,573 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1455551404320_0001_000001 2016-02-15 11:18:51,663 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2016-02-15 11:18:51,768 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens: 2016-02-15 11:18:51,769 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 1 cluster_timestamp: 1455551404320 } attemptId: 1 } keyId: 1239204273) 2016-02-15 11:18:52,143 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:HDPCA, Ident: (HDFS_DELEGATION_TOKEN token 601 for sqoop) 2016-02-15 11:18:52,146 WARN [main] org.apache.hadoop.security.token.Token: Cannot find class for token kind kms-dt 2016-02-15 11:18:52,146 WARN [main] org.apache.hadoop.security.token.Token: Cannot find class for token kind kms-dt Kind: kms-dt, Service: 192.168.0.102:9292, Ident: 00 05 73 71 6f 6f 70 02 72 6d 00 8a 01 52 e5 b4 d7 eb 8a 01 53 09 c1 5b eb 01 02 2016-02-15 11:18:52,146 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: TIMELINE_DELEGATION_TOKEN, Service: 192.168.122.40:8188, Ident: (owner=sqoop, renewer=yarn, realUser=, issueDate=1455552860415, maxDate=1456157660415, sequenceNumber=175, masterKeyId=276) 2016-02-15 11:18:52,217 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred newApiCommitter. 2016-02-15 11:18:52,241 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null 2016-02-15 11:18:52,620 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.sqoop.mapreduce.NullOutputCommitter 2016-02-15 11:19:02,222 WARN [main] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. 2016-02-15 11:19:06,086 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler 2016-02-15 11:19:06,088 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher 2016-02-15 11:19:06,089 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher 2016-02-15 11:19:06,090 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher 2016-02-15 11:19:06,091 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler 2016-02-15 11:19:06,092 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher 2016-02-15 11:19:06,093 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter 2016-02-15 11:19:06,094 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter 2016-02-15 11:19:06,362 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore - ignoring 2016-02-15 11:19:06,656 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore - ignoring 2016-02-15 11:19:06,998 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore - ignoring 2016-02-15 11:19:07,596 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job history data to the timeline server is not enabled 2016-02-15 11:19:08,263 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler 2016-02-15 11:19:11,716 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties 2016-02-15 11:19:13,442 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2016-02-15 11:19:13,477 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started 2016-02-15 11:19:13,518 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1455551404320_0001 to jobTokenSecretManager 2016-02-15 11:19:15,963 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing job_1455551404320_0001 because: not enabled; 2016-02-15 11:19:16,145 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1455551404320_0001 = 22929. Number of splits = 4 2016-02-15 11:19:16,145 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1455551404320_0001 = 0 2016-02-15 11:19:16,145 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1455551404320_0001Job Transitioned from NEW to INITED 2016-02-15 11:19:16,191 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, non-uberized, multi-container job job_1455551404320_0001. 2016-02-15 11:19:16,641 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue 2016-02-15 11:19:16,764 INFO [Socket Reader #1 for port 54574] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 54574 2016-02-15 11:19:16,951 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server 2016-02-15 11:19:17,428 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2016-02-15 11:19:17,443 INFO [IPC Server listener on 54574] org.apache.hadoop.ipc.Server: IPC Server listener on 54574: starting 2016-02-15 11:19:17,504 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at Lnx1.localdomain.com/192.168.122.40:54574 2016-02-15 11:19:19,297 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2016-02-15 11:19:19,424 INFO [main] org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2016-02-15 11:19:19,532 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.mapreduce is not defined 2016-02-15 11:19:19,570 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2016-02-15 11:19:19,646 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce 2016-02-15 11:19:19,647 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static 2016-02-15 11:19:19,691 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/* 2016-02-15 11:19:19,691 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* 2016-02-15 11:19:22,339 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules 2016-02-15 11:19:22,342 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 60717 2016-02-15 11:19:22,344 INFO [main] org.mortbay.log: jetty-6.1.26.hwx 2016-02-15 11:19:22,604 INFO [main] org.mortbay.log: Extract jar:file:/hadoop/yarn/local/filecache/13/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.3.4.0-3485.jar!/webapps/mapreduce to /hadoop/yarn/local/usercache/sqoop/appcache/application_1455551404320_0001/container_e127_1455551404320_0001_01_000001/tmp/Jetty_0_0_0_0_60717_mapreduce____.76wydm/webapp 2016-02-15 11:19:33,399 INFO [main] org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:60717 2016-02-15 11:19:33,399 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app mapreduce started at 60717 2016-02-15 11:19:33,487 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue 2016-02-15 11:19:33,490 INFO [Socket Reader #1 for port 53263] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 53263 2016-02-15 11:19:33,651 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2016-02-15 11:19:33,662 INFO [IPC Server listener on 53263] org.apache.hadoop.ipc.Server: IPC Server listener on 53263: starting 2016-02-15 11:19:34,270 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true 2016-02-15 11:19:34,270 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3 2016-02-15 11:19:34,270 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33 2016-02-15 11:19:34,493 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at Lnx1.localdomain.com/192.168.122.40:8030 2016-02-15 11:19:35,604 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: maxContainerCapability: 2016-02-15 11:19:35,604 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default 2016-02-15 11:19:35,654 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit on the thread pool size is 500 2016-02-15 11:19:35,654 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The thread pool initial size is 10 2016-02-15 11:19:35,718 INFO [main] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 2016-02-15 11:19:35,853 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1455551404320_0001Job Transitioned from INITED to SETUP 2016-02-15 11:19:35,856 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP 2016-02-15 11:19:35,858 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1455551404320_0001Job Transitioned from SETUP to RUNNING 2016-02-15 11:19:37,809 INFO [Socket Reader #1 for port 54574] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for sqoop/lnx2.localdomain.com@EXAMPLE.COM (auth:SIMPLE) 2016-02-15 11:19:37,868 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1455551404320_0001, File: hdfs://HDPCA:8020/user/sqoop/.staging/job_1455551404320_0001/job_1455551404320_0001_1.jhist 2016-02-15 11:19:38,036 INFO [Socket Reader #1 for port 54574] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for sqoop/lnx2.localdomain.com@EXAMPLE.COM (auth:TOKEN) for protocol=interface org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB 2016-02-15 11:19:40,491 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx0.localdomain.com to /default-rack 2016-02-15 11:19:40,564 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000000 Task Transitioned from NEW to SCHEDULED 2016-02-15 11:19:40,581 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx0.localdomain.com to /default-rack 2016-02-15 11:19:40,581 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000001 Task Transitioned from NEW to SCHEDULED 2016-02-15 11:19:40,581 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx0.localdomain.com to /default-rack 2016-02-15 11:19:40,582 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000002 Task Transitioned from NEW to SCHEDULED 2016-02-15 11:19:40,582 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx0.localdomain.com to /default-rack 2016-02-15 11:19:40,582 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000003 Task Transitioned from NEW to SCHEDULED 2016-02-15 11:19:40,584 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-02-15 11:19:40,584 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_0 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-02-15 11:19:40,584 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_0 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-02-15 11:19:40,585 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000003_0 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-02-15 11:19:41,944 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceRequest: 2016-02-15 11:19:42,943 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:4 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0 2016-02-15 11:19:42,952 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:19:45,030 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-02-15 11:19:45,067 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:19:45,069 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e127_1455551404320_0001_01_000002 to attempt_1455551404320_0001_m_000000_0 2016-02-15 11:19:45,071 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:3 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:1 2016-02-15 11:19:45,245 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:19:45,290 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar file on the remote FS is hdfs://HDPCA/user/sqoop/.staging/job_1455551404320_0001/job.jar 2016-02-15 11:19:45,310 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /user/sqoop/.staging/job_1455551404320_0001/job.xml 2016-02-15 11:19:45,513 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #3 tokens and #2 secret keys for NM use for launching container 2016-02-15 11:19:45,513 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 4 2016-02-15 11:19:45,514 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData 2016-02-15 11:19:46,662 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-02-15 11:19:46,691 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=3 release= 0 newContainers=2 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:19:46,691 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 2 2016-02-15 11:19:46,691 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:19:46,691 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e127_1455551404320_0001_01_000003 to attempt_1455551404320_0001_m_000001_0 2016-02-15 11:19:46,691 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:19:46,692 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e127_1455551404320_0001_01_000004 to attempt_1455551404320_0001_m_000002_0 2016-02-15 11:19:46,702 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:19:46,703 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-02-15 11:19:46,704 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:19:46,704 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-02-15 11:19:46,709 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:19:46,717 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e127_1455551404320_0001_01_000002 taskAttempt attempt_1455551404320_0001_m_000000_0 2016-02-15 11:19:46,721 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1455551404320_0001_m_000000_0 2016-02-15 11:19:46,726 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e127_1455551404320_0001_01_000003 taskAttempt attempt_1455551404320_0001_m_000001_0 2016-02-15 11:19:46,726 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1455551404320_0001_m_000001_0 2016-02-15 11:19:46,730 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e127_1455551404320_0001_01_000004 taskAttempt attempt_1455551404320_0001_m_000002_0 2016-02-15 11:19:46,730 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1455551404320_0001_m_000002_0 2016-02-15 11:19:46,743 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:19:46,892 INFO [ContainerLauncher #2] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:19:46,906 INFO [ContainerLauncher #1] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:19:47,185 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1455551404320_0001_m_000001_0 : 13562 2016-02-15 11:19:47,189 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1455551404320_0001_m_000002_0 : 13562 2016-02-15 11:19:47,191 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1455551404320_0001_m_000001_0] using containerId: [container_e127_1455551404320_0001_01_000003 on NM: [Lnx1.localdomain.com:45454] 2016-02-15 11:19:47,195 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_0 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-02-15 11:19:47,196 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1455551404320_0001_m_000002_0] using containerId: [container_e127_1455551404320_0001_01_000004 on NM: [Lnx1.localdomain.com:45454] 2016-02-15 11:19:47,196 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_0 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-02-15 11:19:47,196 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000001 Task Transitioned from SCHEDULED to RUNNING 2016-02-15 11:19:47,197 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000002 Task Transitioned from SCHEDULED to RUNNING 2016-02-15 11:19:47,200 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1455551404320_0001_m_000000_0 : 13562 2016-02-15 11:19:47,207 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1455551404320_0001_m_000000_0] using containerId: [container_e127_1455551404320_0001_01_000002 on NM: [Lnx1.localdomain.com:45454] 2016-02-15 11:19:47,207 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-02-15 11:19:47,208 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000000 Task Transitioned from SCHEDULED to RUNNING 2016-02-15 11:19:47,722 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:21:43,667 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1455551404320_0001 (auth:SIMPLE) 2016-02-15 11:21:43,687 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1455551404320_0001 (auth:SIMPLE) 2016-02-15 11:21:43,688 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1455551404320_0001 (auth:SIMPLE) 2016-02-15 11:21:43,755 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for job_1455551404320_0001 (auth:TOKEN) for protocol=interface org.apache.hadoop.mapred.TaskUmbilicalProtocol 2016-02-15 11:21:43,766 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for job_1455551404320_0001 (auth:TOKEN) for protocol=interface org.apache.hadoop.mapred.TaskUmbilicalProtocol 2016-02-15 11:21:43,768 INFO [IPC Server handler 28 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1455551404320_0001_m_139637976727554 asked for a task 2016-02-15 11:21:43,772 INFO [IPC Server handler 29 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1455551404320_0001_m_139637976727556 asked for a task 2016-02-15 11:21:43,772 INFO [IPC Server handler 29 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1455551404320_0001_m_139637976727556 given task: attempt_1455551404320_0001_m_000002_0 2016-02-15 11:21:43,772 INFO [IPC Server handler 28 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1455551404320_0001_m_139637976727554 given task: attempt_1455551404320_0001_m_000000_0 2016-02-15 11:21:43,849 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for job_1455551404320_0001 (auth:TOKEN) for protocol=interface org.apache.hadoop.mapred.TaskUmbilicalProtocol 2016-02-15 11:21:43,850 INFO [IPC Server handler 27 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1455551404320_0001_m_139637976727555 asked for a task 2016-02-15 11:21:43,850 INFO [IPC Server handler 27 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1455551404320_0001_m_139637976727555 given task: attempt_1455551404320_0001_m_000001_0 2016-02-15 11:22:02,562 INFO [IPC Server handler 26 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000000_0 is : 0.0 2016-02-15 11:22:02,569 INFO [IPC Server handler 24 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000002_0 is : 0.0 2016-02-15 11:22:02,563 INFO [IPC Server handler 25 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000001_0 is : 0.0 2016-02-15 11:22:08,777 INFO [IPC Server handler 23 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000002_0 is : 1.0 2016-02-15 11:22:08,781 INFO [IPC Server handler 21 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000001_0 is : 1.0 2016-02-15 11:22:08,780 INFO [IPC Server handler 22 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000000_0 is : 1.0 2016-02-15 11:27:38,727 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000001_0: AttemptID:attempt_1455551404320_0001_m_000001_0 Timed out after 300 secs 2016-02-15 11:27:38,838 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_0 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-02-15 11:27:38,838 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000002_0: AttemptID:attempt_1455551404320_0001_m_000002_0 Timed out after 300 secs 2016-02-15 11:27:38,839 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_0 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-02-15 11:27:38,839 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000000_0: AttemptID:attempt_1455551404320_0001_m_000000_0 Timed out after 300 secs 2016-02-15 11:27:38,839 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-02-15 11:27:38,854 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e127_1455551404320_0001_01_000003 taskAttempt attempt_1455551404320_0001_m_000001_0 2016-02-15 11:27:38,856 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e127_1455551404320_0001_01_000004 taskAttempt attempt_1455551404320_0001_m_000002_0 2016-02-15 11:27:38,856 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1455551404320_0001_m_000001_0 2016-02-15 11:27:38,857 INFO [ContainerLauncher #3] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:27:38,861 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1455551404320_0001_m_000002_0 2016-02-15 11:27:38,861 INFO [ContainerLauncher #4] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:27:38,867 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e127_1455551404320_0001_01_000002 taskAttempt attempt_1455551404320_0001_m_000000_0 2016-02-15 11:27:38,871 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1455551404320_0001_m_000000_0 2016-02-15 11:27:38,871 INFO [ContainerLauncher #5] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:27:39,701 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_0 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-02-15 11:27:39,701 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_0 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-02-15 11:27:39,701 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_0 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-02-15 11:27:39,704 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-02-15 11:27:39,706 INFO [CommitterEvent Processor #2] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-02-15 11:27:39,706 INFO [CommitterEvent Processor #3] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-02-15 11:27:39,716 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_0 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-02-15 11:27:39,717 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_0 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-02-15 11:27:39,717 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_0 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-02-15 11:27:39,949 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx0.localdomain.com to /default-rack 2016-02-15 11:27:40,013 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx0.localdomain.com to /default-rack 2016-02-15 11:27:40,013 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx0.localdomain.com to /default-rack 2016-02-15 11:27:40,016 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_1 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-02-15 11:27:40,017 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_1 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-02-15 11:27:40,017 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_1 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-02-15 11:27:40,017 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 1 failures on node Lnx1.localdomain.com 2016-02-15 11:27:40,017 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 2 failures on node Lnx1.localdomain.com 2016-02-15 11:27:40,017 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 3 failures on node Lnx1.localdomain.com 2016-02-15 11:27:40,017 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Blacklisted host Lnx1.localdomain.com 2016-02-15 11:27:40,018 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1455551404320_0001_m_000002_1 to list of failed maps 2016-02-15 11:27:40,019 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1455551404320_0001_m_000000_1 to list of failed maps 2016-02-15 11:27:40,020 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1455551404320_0001_m_000001_1 to list of failed maps 2016-02-15 11:27:41,024 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:4 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:27:41,048 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:27:41,048 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Update the blacklist for application_1455551404320_0001: blacklistAdditions=1 blacklistRemovals=0 2016-02-15 11:27:41,048 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Ignore blacklisting set to true. Known: 1, Blacklisted: 1, 100% 2016-02-15 11:27:42,138 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Update the blacklist for application_1455551404320_0001: blacklistAdditions=0 blacklistRemovals=1 2016-02-15 11:27:42,138 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e127_1455551404320_0001_01_000003 2016-02-15 11:27:42,139 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e127_1455551404320_0001_01_000004 2016-02-15 11:27:42,139 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e127_1455551404320_0001_01_000002 2016-02-15 11:27:42,139 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:4 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:27:42,139 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000001_0: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-02-15 11:27:42,139 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000002_0: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-02-15 11:27:42,139 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000000_0: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-02-15 11:27:43,176 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-02-15 11:27:43,177 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_e127_1455551404320_0001_01_000005, NodeId: Lnx1.localdomain.com:45454, NodeHttpAddress: Lnx1.localdomain.com:8042, Resource: , Priority: 5, Token: Token { kind: ContainerToken, service: 192.168.122.40:45454 }, ] to fast fail map 2016-02-15 11:27:43,177 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps 2016-02-15 11:27:43,179 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e127_1455551404320_0001_01_000005 to attempt_1455551404320_0001_m_000002_1 2016-02-15 11:27:43,179 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:3 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:4 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:27:43,179 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:27:43,180 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_1 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-02-15 11:27:43,195 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e127_1455551404320_0001_01_000005 taskAttempt attempt_1455551404320_0001_m_000002_1 2016-02-15 11:27:43,195 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1455551404320_0001_m_000002_1 2016-02-15 11:27:43,195 INFO [ContainerLauncher #6] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:27:43,262 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1455551404320_0001_m_000002_1 : 13562 2016-02-15 11:27:43,262 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1455551404320_0001_m_000002_1] using containerId: [container_e127_1455551404320_0001_01_000005 on NM: [Lnx1.localdomain.com:45454] 2016-02-15 11:27:43,262 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_1 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-02-15 11:27:44,205 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=1 release= 0 newContainers=1 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:27:44,205 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-02-15 11:27:44,206 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_e127_1455551404320_0001_01_000006, NodeId: Lnx1.localdomain.com:45454, NodeHttpAddress: Lnx1.localdomain.com:8042, Resource: , Priority: 5, Token: Token { kind: ContainerToken, service: 192.168.122.40:45454 }, ] to fast fail map 2016-02-15 11:27:44,206 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps 2016-02-15 11:27:44,206 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e127_1455551404320_0001_01_000006 to attempt_1455551404320_0001_m_000000_1 2016-02-15 11:27:44,206 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:2 ScheduledReds:0 AssignedMaps:2 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:5 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:27:44,206 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:27:44,207 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_1 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-02-15 11:27:44,245 INFO [ContainerLauncher #7] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e127_1455551404320_0001_01_000006 taskAttempt attempt_1455551404320_0001_m_000000_1 2016-02-15 11:27:44,245 INFO [ContainerLauncher #7] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1455551404320_0001_m_000000_1 2016-02-15 11:27:44,245 INFO [ContainerLauncher #7] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:27:44,405 INFO [ContainerLauncher #7] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1455551404320_0001_m_000000_1 : 13562 2016-02-15 11:27:44,406 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1455551404320_0001_m_000000_1] using containerId: [container_e127_1455551404320_0001_01_000006 on NM: [Lnx1.localdomain.com:45454] 2016-02-15 11:27:44,406 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_1 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-02-15 11:27:45,220 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=1 release= 0 newContainers=1 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:27:45,220 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-02-15 11:27:45,220 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_e127_1455551404320_0001_01_000007, NodeId: Lnx1.localdomain.com:45454, NodeHttpAddress: Lnx1.localdomain.com:8042, Resource: , Priority: 5, Token: Token { kind: ContainerToken, service: 192.168.122.40:45454 }, ] to fast fail map 2016-02-15 11:27:45,220 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps 2016-02-15 11:27:45,220 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e127_1455551404320_0001_01_000007 to attempt_1455551404320_0001_m_000001_1 2016-02-15 11:27:45,220 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:6 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:27:45,221 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:27:45,221 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_1 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-02-15 11:27:45,248 INFO [ContainerLauncher #8] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e127_1455551404320_0001_01_000007 taskAttempt attempt_1455551404320_0001_m_000001_1 2016-02-15 11:27:45,248 INFO [ContainerLauncher #8] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1455551404320_0001_m_000001_1 2016-02-15 11:27:45,248 INFO [ContainerLauncher #8] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:27:45,516 INFO [ContainerLauncher #8] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1455551404320_0001_m_000001_1 : 13562 2016-02-15 11:27:45,517 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1455551404320_0001_m_000001_1] using containerId: [container_e127_1455551404320_0001_01_000007 on NM: [Lnx1.localdomain.com:45454] 2016-02-15 11:27:45,517 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_1 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-02-15 11:27:46,225 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:28:30,377 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1455551404320_0001 (auth:SIMPLE) 2016-02-15 11:28:30,417 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1455551404320_0001 (auth:SIMPLE) 2016-02-15 11:28:30,428 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1455551404320_0001 (auth:SIMPLE) 2016-02-15 11:28:30,514 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for job_1455551404320_0001 (auth:TOKEN) for protocol=interface org.apache.hadoop.mapred.TaskUmbilicalProtocol 2016-02-15 11:28:30,515 INFO [IPC Server handler 15 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1455551404320_0001_m_139637976727559 asked for a task 2016-02-15 11:28:30,515 INFO [IPC Server handler 15 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1455551404320_0001_m_139637976727559 given task: attempt_1455551404320_0001_m_000001_1 2016-02-15 11:28:30,523 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for job_1455551404320_0001 (auth:TOKEN) for protocol=interface org.apache.hadoop.mapred.TaskUmbilicalProtocol 2016-02-15 11:28:30,524 INFO [IPC Server handler 13 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1455551404320_0001_m_139637976727558 asked for a task 2016-02-15 11:28:30,524 INFO [IPC Server handler 13 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1455551404320_0001_m_139637976727558 given task: attempt_1455551404320_0001_m_000000_1 2016-02-15 11:28:30,534 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for job_1455551404320_0001 (auth:TOKEN) for protocol=interface org.apache.hadoop.mapred.TaskUmbilicalProtocol 2016-02-15 11:28:30,534 INFO [IPC Server handler 27 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1455551404320_0001_m_139637976727557 asked for a task 2016-02-15 11:28:30,535 INFO [IPC Server handler 27 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1455551404320_0001_m_139637976727557 given task: attempt_1455551404320_0001_m_000002_1 2016-02-15 11:28:44,121 INFO [IPC Server handler 16 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000001_1 is : 0.0 2016-02-15 11:28:44,195 INFO [IPC Server handler 11 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000002_1 is : 0.0 2016-02-15 11:28:44,337 INFO [IPC Server handler 9 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000000_1 is : 0.0 2016-02-15 11:28:48,388 INFO [IPC Server handler 5 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000002_1 is : 1.0 2016-02-15 11:28:48,457 INFO [IPC Server handler 1 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000001_1 is : 1.0 2016-02-15 11:28:48,465 INFO [IPC Server handler 15 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000000_1 is : 1.0 2016-02-15 11:34:08,886 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000002_1: AttemptID:attempt_1455551404320_0001_m_000002_1 Timed out after 300 secs 2016-02-15 11:34:08,887 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_1 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-02-15 11:34:08,887 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000000_1: AttemptID:attempt_1455551404320_0001_m_000000_1 Timed out after 300 secs 2016-02-15 11:34:08,887 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_1 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-02-15 11:34:08,887 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000001_1: AttemptID:attempt_1455551404320_0001_m_000001_1 Timed out after 300 secs 2016-02-15 11:34:08,887 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_1 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-02-15 11:34:08,936 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e127_1455551404320_0001_01_000006 taskAttempt attempt_1455551404320_0001_m_000000_1 2016-02-15 11:34:08,936 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e127_1455551404320_0001_01_000007 taskAttempt attempt_1455551404320_0001_m_000001_1 2016-02-15 11:34:09,184 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1455551404320_0001_m_000000_1 2016-02-15 11:34:09,185 INFO [ContainerLauncher #1] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:34:09,189 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1455551404320_0001_m_000001_1 2016-02-15 11:34:09,189 INFO [ContainerLauncher #2] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:34:09,212 INFO [ContainerLauncher #9] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e127_1455551404320_0001_01_000005 taskAttempt attempt_1455551404320_0001_m_000002_1 2016-02-15 11:34:09,217 INFO [ContainerLauncher #9] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1455551404320_0001_m_000002_1 2016-02-15 11:34:09,218 INFO [ContainerLauncher #9] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:34:10,142 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_1 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-02-15 11:34:10,143 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_1 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-02-15 11:34:10,200 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-02-15 11:34:10,201 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_1 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-02-15 11:34:10,202 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx0.localdomain.com to /default-rack 2016-02-15 11:34:10,202 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_2 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-02-15 11:34:10,249 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1455551404320_0001_m_000002_2 to list of failed maps 2016-02-15 11:34:10,249 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:2 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:6 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:34:10,254 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:34:10,256 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_1 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-02-15 11:34:10,257 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-02-15 11:34:10,257 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_1 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-02-15 11:34:10,258 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx0.localdomain.com to /default-rack 2016-02-15 11:34:10,259 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_2 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-02-15 11:34:10,260 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1455551404320_0001_m_000000_2 to list of failed maps 2016-02-15 11:34:10,274 INFO [CommitterEvent Processor #4] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-02-15 11:34:10,274 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_1 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-02-15 11:34:10,275 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx0.localdomain.com to /default-rack 2016-02-15 11:34:10,276 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_2 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-02-15 11:34:10,277 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1455551404320_0001_m_000001_2 to list of failed maps 2016-02-15 11:34:11,261 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:4 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:6 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:34:11,265 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:34:12,329 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e127_1455551404320_0001_01_000007 2016-02-15 11:34:12,330 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e127_1455551404320_0001_01_000005 2016-02-15 11:34:12,330 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e127_1455551404320_0001_01_000006 2016-02-15 11:34:12,330 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-02-15 11:34:12,330 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_e127_1455551404320_0001_01_000008, NodeId: Lnx1.localdomain.com:45454, NodeHttpAddress: Lnx1.localdomain.com:8042, Resource: , Priority: 5, Token: Token { kind: ContainerToken, service: 192.168.122.40:45454 }, ] to fast fail map 2016-02-15 11:34:12,330 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000001_1: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-02-15 11:34:12,330 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000002_1: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-02-15 11:34:12,331 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000000_1: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-02-15 11:34:12,332 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps 2016-02-15 11:34:12,333 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e127_1455551404320_0001_01_000008 to attempt_1455551404320_0001_m_000002_2 2016-02-15 11:34:12,333 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:3 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:7 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:34:12,334 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:34:12,334 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_2 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-02-15 11:34:12,335 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e127_1455551404320_0001_01_000008 taskAttempt attempt_1455551404320_0001_m_000002_2 2016-02-15 11:34:12,335 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1455551404320_0001_m_000002_2 2016-02-15 11:34:12,335 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:34:12,480 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1455551404320_0001_m_000002_2 : 13562 2016-02-15 11:34:12,481 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1455551404320_0001_m_000002_2] using containerId: [container_e127_1455551404320_0001_01_000008 on NM: [Lnx1.localdomain.com:45454] 2016-02-15 11:34:12,481 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_2 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-02-15 11:34:13,356 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=1 release= 0 newContainers=1 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:34:13,357 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-02-15 11:34:13,357 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_e127_1455551404320_0001_01_000009, NodeId: Lnx1.localdomain.com:45454, NodeHttpAddress: Lnx1.localdomain.com:8042, Resource: , Priority: 5, Token: Token { kind: ContainerToken, service: 192.168.122.40:45454 }, ] to fast fail map 2016-02-15 11:34:13,357 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps 2016-02-15 11:34:13,357 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e127_1455551404320_0001_01_000009 to attempt_1455551404320_0001_m_000000_2 2016-02-15 11:34:13,357 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:2 ScheduledReds:0 AssignedMaps:2 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:8 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:34:13,358 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:34:13,359 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_2 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-02-15 11:34:13,362 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e127_1455551404320_0001_01_000009 taskAttempt attempt_1455551404320_0001_m_000000_2 2016-02-15 11:34:13,362 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1455551404320_0001_m_000000_2 2016-02-15 11:34:13,362 INFO [ContainerLauncher #4] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:34:13,503 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1455551404320_0001_m_000000_2 : 13562 2016-02-15 11:34:13,504 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1455551404320_0001_m_000000_2] using containerId: [container_e127_1455551404320_0001_01_000009 on NM: [Lnx1.localdomain.com:45454] 2016-02-15 11:34:13,504 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_2 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-02-15 11:34:14,369 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=1 release= 0 newContainers=1 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:34:14,370 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-02-15 11:34:14,370 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_e127_1455551404320_0001_01_000010, NodeId: Lnx1.localdomain.com:45454, NodeHttpAddress: Lnx1.localdomain.com:8042, Resource: , Priority: 5, Token: Token { kind: ContainerToken, service: 192.168.122.40:45454 }, ] to fast fail map 2016-02-15 11:34:14,370 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps 2016-02-15 11:34:14,370 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e127_1455551404320_0001_01_000010 to attempt_1455551404320_0001_m_000001_2 2016-02-15 11:34:14,370 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:9 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:34:14,371 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:34:14,371 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_2 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-02-15 11:34:14,373 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e127_1455551404320_0001_01_000010 taskAttempt attempt_1455551404320_0001_m_000001_2 2016-02-15 11:34:14,374 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1455551404320_0001_m_000001_2 2016-02-15 11:34:14,374 INFO [ContainerLauncher #5] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:34:14,594 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1455551404320_0001_m_000001_2 : 13562 2016-02-15 11:34:14,595 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1455551404320_0001_m_000001_2] using containerId: [container_e127_1455551404320_0001_01_000010 on NM: [Lnx1.localdomain.com:45454] 2016-02-15 11:34:14,595 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_2 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-02-15 11:34:15,382 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:34:37,397 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1455551404320_0001 (auth:SIMPLE) 2016-02-15 11:34:37,620 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for job_1455551404320_0001 (auth:TOKEN) for protocol=interface org.apache.hadoop.mapred.TaskUmbilicalProtocol 2016-02-15 11:34:37,621 INFO [IPC Server handler 15 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1455551404320_0001_m_139637976727561 asked for a task 2016-02-15 11:34:37,621 INFO [IPC Server handler 15 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1455551404320_0001_m_139637976727561 given task: attempt_1455551404320_0001_m_000000_2 2016-02-15 11:34:37,686 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1455551404320_0001 (auth:SIMPLE) 2016-02-15 11:34:38,030 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for job_1455551404320_0001 (auth:TOKEN) for protocol=interface org.apache.hadoop.mapred.TaskUmbilicalProtocol 2016-02-15 11:34:38,031 INFO [IPC Server handler 1 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1455551404320_0001_m_139637976727560 asked for a task 2016-02-15 11:34:38,031 INFO [IPC Server handler 1 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1455551404320_0001_m_139637976727560 given task: attempt_1455551404320_0001_m_000002_2 2016-02-15 11:34:39,707 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1455551404320_0001 (auth:SIMPLE) 2016-02-15 11:34:39,919 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for job_1455551404320_0001 (auth:TOKEN) for protocol=interface org.apache.hadoop.mapred.TaskUmbilicalProtocol 2016-02-15 11:34:39,919 INFO [IPC Server handler 1 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1455551404320_0001_m_139637976727562 asked for a task 2016-02-15 11:34:39,919 INFO [IPC Server handler 1 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1455551404320_0001_m_139637976727562 given task: attempt_1455551404320_0001_m_000001_2 2016-02-15 11:34:54,406 INFO [IPC Server handler 5 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000002_2 is : 0.0 2016-02-15 11:34:54,442 INFO [IPC Server handler 15 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000000_2 is : 0.0 2016-02-15 11:34:55,664 INFO [IPC Server handler 27 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000001_2 is : 0.0 2016-02-15 11:34:58,645 INFO [IPC Server handler 27 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000000_2 is : 1.0 2016-02-15 11:34:58,759 INFO [IPC Server handler 4 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000002_2 is : 1.0 2016-02-15 11:35:00,070 INFO [IPC Server handler 5 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000001_2 is : 1.0 2016-02-15 11:35:02,437 INFO [IPC Server handler 15 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000000_2 is : 1.0 2016-02-15 11:35:02,631 INFO [IPC Server handler 27 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000002_2 is : 1.0 2016-02-15 11:35:03,425 INFO [IPC Server handler 15 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000001_2 is : 1.0 2016-02-15 11:40:08,925 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000000_2: AttemptID:attempt_1455551404320_0001_m_000000_2 Timed out after 300 secs 2016-02-15 11:40:08,925 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_2 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-02-15 11:40:08,925 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000001_2: AttemptID:attempt_1455551404320_0001_m_000001_2 Timed out after 300 secs 2016-02-15 11:40:08,926 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_2 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-02-15 11:40:08,926 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000002_2: AttemptID:attempt_1455551404320_0001_m_000002_2 Timed out after 300 secs 2016-02-15 11:40:08,926 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_2 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-02-15 11:40:08,932 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e127_1455551404320_0001_01_000009 taskAttempt attempt_1455551404320_0001_m_000000_2 2016-02-15 11:40:08,933 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e127_1455551404320_0001_01_000010 taskAttempt attempt_1455551404320_0001_m_000001_2 2016-02-15 11:40:08,934 INFO [ContainerLauncher #7] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e127_1455551404320_0001_01_000008 taskAttempt attempt_1455551404320_0001_m_000002_2 2016-02-15 11:40:08,935 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1455551404320_0001_m_000000_2 2016-02-15 11:40:08,935 INFO [ContainerLauncher #3] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:40:08,942 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1455551404320_0001_m_000001_2 2016-02-15 11:40:08,942 INFO [ContainerLauncher #6] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:40:08,945 INFO [ContainerLauncher #7] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1455551404320_0001_m_000002_2 2016-02-15 11:40:08,946 INFO [ContainerLauncher #7] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:40:09,295 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_2 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-02-15 11:40:09,296 INFO [CommitterEvent Processor #2] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-02-15 11:40:09,296 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_2 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-02-15 11:40:09,297 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx0.localdomain.com to /default-rack 2016-02-15 11:40:09,298 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_3 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-02-15 11:40:09,308 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1455551404320_0001_m_000002_3 to list of failed maps 2016-02-15 11:40:09,416 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_2 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-02-15 11:40:09,418 INFO [CommitterEvent Processor #3] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-02-15 11:40:09,425 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_2 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-02-15 11:40:09,426 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx0.localdomain.com to /default-rack 2016-02-15 11:40:09,427 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_3 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-02-15 11:40:09,427 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1455551404320_0001_m_000000_3 to list of failed maps 2016-02-15 11:40:09,442 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_2 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-02-15 11:40:09,443 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-02-15 11:40:09,443 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_2 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-02-15 11:40:09,444 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx0.localdomain.com to /default-rack 2016-02-15 11:40:09,444 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_3 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-02-15 11:40:09,445 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1455551404320_0001_m_000001_3 to list of failed maps 2016-02-15 11:40:10,270 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:4 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:9 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:40:10,295 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:40:13,398 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e127_1455551404320_0001_01_000008 2016-02-15 11:40:13,398 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-02-15 11:40:13,398 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_e127_1455551404320_0001_01_000011, NodeId: Lnx1.localdomain.com:45454, NodeHttpAddress: Lnx1.localdomain.com:8042, Resource: , Priority: 5, Token: Token { kind: ContainerToken, service: 192.168.122.40:45454 }, ] to fast fail map 2016-02-15 11:40:13,398 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps 2016-02-15 11:40:13,401 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000002_2: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-02-15 11:40:13,407 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e127_1455551404320_0001_01_000011 to attempt_1455551404320_0001_m_000002_3 2016-02-15 11:40:13,408 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:3 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:10 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:40:13,409 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:40:13,410 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_3 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-02-15 11:40:13,410 INFO [ContainerLauncher #8] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e127_1455551404320_0001_01_000011 taskAttempt attempt_1455551404320_0001_m_000002_3 2016-02-15 11:40:13,410 INFO [ContainerLauncher #8] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1455551404320_0001_m_000002_3 2016-02-15 11:40:13,411 INFO [ContainerLauncher #8] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:40:13,592 INFO [ContainerLauncher #8] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1455551404320_0001_m_000002_3 : 13562 2016-02-15 11:40:13,593 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1455551404320_0001_m_000002_3] using containerId: [container_e127_1455551404320_0001_01_000011 on NM: [Lnx1.localdomain.com:45454] 2016-02-15 11:40:13,593 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_3 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-02-15 11:40:14,433 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=1 release= 0 newContainers=1 finishedContainers=2 resourcelimit= knownNMs=1 2016-02-15 11:40:14,433 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e127_1455551404320_0001_01_000009 2016-02-15 11:40:14,433 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e127_1455551404320_0001_01_000010 2016-02-15 11:40:14,433 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-02-15 11:40:14,434 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_e127_1455551404320_0001_01_000012, NodeId: Lnx1.localdomain.com:45454, NodeHttpAddress: Lnx1.localdomain.com:8042, Resource: , Priority: 5, Token: Token { kind: ContainerToken, service: 192.168.122.40:45454 }, ] to fast fail map 2016-02-15 11:40:14,434 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps 2016-02-15 11:40:14,434 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e127_1455551404320_0001_01_000012 to attempt_1455551404320_0001_m_000000_3 2016-02-15 11:40:14,434 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:2 ScheduledReds:0 AssignedMaps:2 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:11 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:40:14,434 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000000_2: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-02-15 11:40:14,434 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000001_2: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-02-15 11:40:14,435 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:40:14,436 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_3 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-02-15 11:40:14,437 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e127_1455551404320_0001_01_000012 taskAttempt attempt_1455551404320_0001_m_000000_3 2016-02-15 11:40:14,438 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1455551404320_0001_m_000000_3 2016-02-15 11:40:14,438 INFO [ContainerLauncher #2] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:40:14,713 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1455551404320_0001_m_000000_3 : 13562 2016-02-15 11:40:14,714 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1455551404320_0001_m_000000_3] using containerId: [container_e127_1455551404320_0001_01_000012 on NM: [Lnx1.localdomain.com:45454] 2016-02-15 11:40:14,714 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_3 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-02-15 11:40:15,472 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=1 release= 0 newContainers=1 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:40:15,472 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-02-15 11:40:15,473 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_e127_1455551404320_0001_01_000013, NodeId: Lnx1.localdomain.com:45454, NodeHttpAddress: Lnx1.localdomain.com:8042, Resource: , Priority: 5, Token: Token { kind: ContainerToken, service: 192.168.122.40:45454 }, ] to fast fail map 2016-02-15 11:40:15,473 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps 2016-02-15 11:40:15,473 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e127_1455551404320_0001_01_000013 to attempt_1455551404320_0001_m_000001_3 2016-02-15 11:40:15,473 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:12 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:40:15,474 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved Lnx1.localdomain.com to /default-rack 2016-02-15 11:40:15,474 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_3 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-02-15 11:40:15,476 INFO [ContainerLauncher #9] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e127_1455551404320_0001_01_000013 taskAttempt attempt_1455551404320_0001_m_000001_3 2016-02-15 11:40:15,476 INFO [ContainerLauncher #9] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1455551404320_0001_m_000001_3 2016-02-15 11:40:15,476 INFO [ContainerLauncher #9] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:40:15,662 INFO [ContainerLauncher #9] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1455551404320_0001_m_000001_3 : 13562 2016-02-15 11:40:15,663 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1455551404320_0001_m_000001_3] using containerId: [container_e127_1455551404320_0001_01_000013 on NM: [Lnx1.localdomain.com:45454] 2016-02-15 11:40:15,664 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_3 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-02-15 11:40:16,489 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:40:37,619 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1455551404320_0001 (auth:SIMPLE) 2016-02-15 11:40:37,906 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for job_1455551404320_0001 (auth:TOKEN) for protocol=interface org.apache.hadoop.mapred.TaskUmbilicalProtocol 2016-02-15 11:40:37,907 INFO [IPC Server handler 14 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1455551404320_0001_m_139637976727563 asked for a task 2016-02-15 11:40:37,907 INFO [IPC Server handler 14 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1455551404320_0001_m_139637976727563 given task: attempt_1455551404320_0001_m_000002_3 2016-02-15 11:40:40,081 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1455551404320_0001 (auth:SIMPLE) 2016-02-15 11:40:40,601 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for job_1455551404320_0001 (auth:TOKEN) for protocol=interface org.apache.hadoop.mapred.TaskUmbilicalProtocol 2016-02-15 11:40:40,602 INFO [IPC Server handler 14 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1455551404320_0001_m_139637976727564 asked for a task 2016-02-15 11:40:40,602 INFO [IPC Server handler 14 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1455551404320_0001_m_139637976727564 given task: attempt_1455551404320_0001_m_000000_3 2016-02-15 11:40:42,015 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1455551404320_0001 (auth:SIMPLE) 2016-02-15 11:40:42,409 INFO [Socket Reader #1 for port 53263] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for job_1455551404320_0001 (auth:TOKEN) for protocol=interface org.apache.hadoop.mapred.TaskUmbilicalProtocol 2016-02-15 11:40:42,410 INFO [IPC Server handler 14 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1455551404320_0001_m_139637976727565 asked for a task 2016-02-15 11:40:42,410 INFO [IPC Server handler 14 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1455551404320_0001_m_139637976727565 given task: attempt_1455551404320_0001_m_000001_3 2016-02-15 11:41:03,582 INFO [IPC Server handler 23 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000002_3 is : 0.0 2016-02-15 11:41:07,959 INFO [IPC Server handler 10 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000000_3 is : 0.0 2016-02-15 11:41:08,649 INFO [IPC Server handler 10 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000002_3 is : 1.0 2016-02-15 11:41:08,868 INFO [IPC Server handler 8 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000001_3 is : 0.0 2016-02-15 11:41:12,685 INFO [IPC Server handler 8 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000001_3 is : 1.0 2016-02-15 11:41:13,422 INFO [IPC Server handler 14 on 53263] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1455551404320_0001_m_000000_3 is : 1.0 2016-02-15 11:46:09,003 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000002_3: AttemptID:attempt_1455551404320_0001_m_000002_3 Timed out after 300 secs 2016-02-15 11:46:09,004 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_3 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP 2016-02-15 11:46:09,005 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e127_1455551404320_0001_01_000011 taskAttempt attempt_1455551404320_0001_m_000002_3 2016-02-15 11:46:09,017 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1455551404320_0001_m_000002_3 2016-02-15 11:46:09,017 INFO [ContainerLauncher #1] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:46:09,240 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_3 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP 2016-02-15 11:46:09,242 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-02-15 11:46:09,242 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000002_3 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED 2016-02-15 11:46:09,490 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000002 Task Transitioned from RUNNING to FAILED 2016-02-15 11:46:09,491 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1 2016-02-15 11:46:09,491 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Job failed as tasks failed. failedMaps:1 failedReduces:0 2016-02-15 11:46:09,534 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1455551404320_0001Job Transitioned from RUNNING to FAIL_WAIT 2016-02-15 11:46:09,534 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000000 Task Transitioned from RUNNING to KILL_WAIT 2016-02-15 11:46:09,535 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000001 Task Transitioned from RUNNING to KILL_WAIT 2016-02-15 11:46:09,535 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000003 Task Transitioned from SCHEDULED to KILL_WAIT 2016-02-15 11:46:09,535 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_3 TaskAttempt Transitioned from RUNNING to KILL_CONTAINER_CLEANUP 2016-02-15 11:46:09,535 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_3 TaskAttempt Transitioned from RUNNING to KILL_CONTAINER_CLEANUP 2016-02-15 11:46:09,535 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000003_0 TaskAttempt Transitioned from UNASSIGNED to KILLED 2016-02-15 11:46:09,536 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000003 Task Transitioned from KILL_WAIT to KILLED 2016-02-15 11:46:09,537 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Processing the event EventType: CONTAINER_DEALLOCATE 2016-02-15 11:46:09,538 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e127_1455551404320_0001_01_000012 taskAttempt attempt_1455551404320_0001_m_000000_3 2016-02-15 11:46:09,538 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e127_1455551404320_0001_01_000013 taskAttempt attempt_1455551404320_0001_m_000001_3 2016-02-15 11:46:09,580 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1455551404320_0001_m_000000_3 2016-02-15 11:46:09,581 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:46:09,581 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1455551404320_0001_m_000001_3 2016-02-15 11:46:09,584 INFO [ContainerLauncher #4] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : Lnx1.localdomain.com:45454 2016-02-15 11:46:09,752 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_3 TaskAttempt Transitioned from KILL_CONTAINER_CLEANUP to KILL_TASK_CLEANUP 2016-02-15 11:46:09,752 INFO [CommitterEvent Processor #4] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-02-15 11:46:09,758 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000000_3 TaskAttempt Transitioned from KILL_TASK_CLEANUP to KILLED 2016-02-15 11:46:09,758 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000000 Task Transitioned from KILL_WAIT to KILLED 2016-02-15 11:46:09,771 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_3 TaskAttempt Transitioned from KILL_CONTAINER_CLEANUP to KILL_TASK_CLEANUP 2016-02-15 11:46:09,772 INFO [CommitterEvent Processor #2] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT 2016-02-15 11:46:09,772 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1455551404320_0001_m_000001_3 TaskAttempt Transitioned from KILL_TASK_CLEANUP to KILLED 2016-02-15 11:46:09,772 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1455551404320_0001_m_000001 Task Transitioned from KILL_WAIT to KILLED 2016-02-15 11:46:09,845 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1455551404320_0001Job Transitioned from FAIL_WAIT to FAIL_ABORT 2016-02-15 11:46:09,846 INFO [CommitterEvent Processor #3] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_ABORT 2016-02-15 11:46:10,252 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1455551404320_0001Job Transitioned from FAIL_ABORT to FAILED 2016-02-15 11:46:10,255 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:12 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:46:10,442 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1455551404320_0001: ask=3 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=1 2016-02-15 11:46:10,444 INFO [Thread-138] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry 2016-02-15 11:46:10,445 INFO [Thread-138] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true 2016-02-15 11:46:10,445 INFO [Thread-138] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator notified that shouldUnregistered is: true 2016-02-15 11:46:10,445 INFO [Thread-138] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true 2016-02-15 11:46:10,445 INFO [Thread-138] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true 2016-02-15 11:46:10,445 INFO [Thread-138] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services 2016-02-15 11:46:10,531 INFO [Thread-138] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0 2016-02-15 11:46:12,467 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e127_1455551404320_0001_01_000013 2016-02-15 11:46:12,467 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e127_1455551404320_0001_01_000011 2016-02-15 11:46:12,467 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e127_1455551404320_0001_01_000012 2016-02-15 11:46:12,468 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:12 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:46:12,468 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000001_3: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-02-15 11:46:12,469 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000002_3: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-02-15 11:46:12,469 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1455551404320_0001_m_000000_3: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-02-15 11:46:12,795 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://HDPCA:8020/user/sqoop/.staging/job_1455551404320_0001/job_1455551404320_0001_1.jhist to hdfs://HDPCA:8020/mr-history/tmp/sqoop/job_1455551404320_0001-1455552861029-sqoop-weather.jar-1455554769491-0-0-FAILED-default-1455553175782.jhist_tmp 2016-02-15 11:46:13,919 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://HDPCA:8020/mr-history/tmp/sqoop/job_1455551404320_0001-1455552861029-sqoop-weather.jar-1455554769491-0-0-FAILED-default-1455553175782.jhist_tmp 2016-02-15 11:46:14,048 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://HDPCA:8020/user/sqoop/.staging/job_1455551404320_0001/job_1455551404320_0001_1_conf.xml to hdfs://HDPCA:8020/mr-history/tmp/sqoop/job_1455551404320_0001_conf.xml_tmp 2016-02-15 11:46:15,360 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://HDPCA:8020/mr-history/tmp/sqoop/job_1455551404320_0001_conf.xml_tmp 2016-02-15 11:46:16,022 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://HDPCA:8020/mr-history/tmp/sqoop/job_1455551404320_0001.summary_tmp to hdfs://HDPCA:8020/mr-history/tmp/sqoop/job_1455551404320_0001.summary 2016-02-15 11:46:16,152 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://HDPCA:8020/mr-history/tmp/sqoop/job_1455551404320_0001_conf.xml_tmp to hdfs://HDPCA:8020/mr-history/tmp/sqoop/job_1455551404320_0001_conf.xml 2016-02-15 11:46:16,278 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://HDPCA:8020/mr-history/tmp/sqoop/job_1455551404320_0001-1455552861029-sqoop-weather.jar-1455554769491-0-0-FAILED-default-1455553175782.jhist_tmp to hdfs://HDPCA:8020/mr-history/tmp/sqoop/job_1455551404320_0001-1455552861029-sqoop-weather.jar-1455554769491-0-0-FAILED-default-1455553175782.jhist 2016-02-15 11:46:16,314 INFO [Thread-138] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop() 2016-02-15 11:46:16,365 INFO [Thread-138] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job diagnostics to Task failed task_1455551404320_0001_m_000002 Job failed as tasks failed. failedMaps:1 failedReduces:0 2016-02-15 11:46:16,366 INFO [Thread-138] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is http://Lnx1.localdomain.com:19888/jobhistory/job/job_1455551404320_0001 2016-02-15 11:46:16,945 INFO [Thread-138] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for application to be successfully unregistered. 2016-02-15 11:46:17,953 INFO [Thread-138] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:12 ContRel:0 HostLocal:0 RackLocal:3 2016-02-15 11:46:17,955 INFO [Thread-138] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://HDPCA /user/sqoop/.staging/job_1455551404320_0001 2016-02-15 11:46:18,223 INFO [Thread-138] org.apache.hadoop.ipc.Server: Stopping server on 53263 2016-02-15 11:46:18,280 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder 2016-02-15 11:46:18,280 INFO [IPC Server listener on 53263] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 53263 2016-02-15 11:46:18,281 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted