syslog -master node container-1 2016-10-11 13:03:48,847 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1476183726669_0001_000001 2016-10-11 13:03:49,160 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. 2016-10-11 13:03:49,179 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. 2016-10-11 13:03:49,264 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2016-10-11 13:03:49,277 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens: 2016-10-11 13:03:49,318 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (org.apache.hadoop.yarn.security.AMRMTokenIdentifier@45b784e4) 2016-10-11 13:03:49,319 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: RM_DELEGATION_TOKEN, Service: 95.142.101.137:8032, Ident: (owner=root, renewer=oozie mr token, realUser=root, issueDate=1476183816547, maxDate=1476788616547, sequenceNumber=2, masterKeyId=2) 2016-10-11 13:03:49,328 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: The specific max attempts: 2 for application: 1. Attempt num: 1 is last retry: false 2016-10-11 13:03:49,472 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. 2016-10-11 13:03:49,486 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. 2016-10-11 13:03:50,076 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null 2016-10-11 13:03:50,078 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter 2016-10-11 13:03:50,137 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler 2016-10-11 13:03:50,139 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher 2016-10-11 13:03:50,140 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher 2016-10-11 13:03:50,141 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher 2016-10-11 13:03:50,142 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler 2016-10-11 13:03:50,143 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher 2016-10-11 13:03:50,143 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter 2016-10-11 13:03:50,145 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter 2016-10-11 13:03:50,215 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler 2016-10-11 13:03:50,486 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 2016-10-11 13:03:50,555 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2016-10-11 13:03:50,555 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started 2016-10-11 13:03:50,569 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1476183726669_0001 to jobTokenSecretManager 2016-10-11 13:03:50,688 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing job_1476183726669_0001 because: not enabled; 2016-10-11 13:03:50,716 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1476183726669_0001 = 0. Number of splits = 1 2016-10-11 13:03:50,717 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1476183726669_0001 = 0 2016-10-11 13:03:50,717 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1476183726669_0001Job Transitioned from NEW to INITED 2016-10-11 13:03:50,718 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, non-uberized, multi-container job job_1476183726669_0001. 2016-10-11 13:03:50,753 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue 2016-10-11 13:03:50,804 INFO [Socket Reader #1 for port 42813] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 42813 2016-10-11 13:03:50,825 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server 2016-10-11 13:03:50,826 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2016-10-11 13:03:50,826 INFO [IPC Server listener on 42813] org.apache.hadoop.ipc.Server: IPC Server listener on 42813: starting 2016-10-11 13:03:50,827 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at ns613.mycyberhosting.com/95.142.101.137:42813 2016-10-11 13:03:50,894 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2016-10-11 13:03:50,898 WARN [main] org.apache.hadoop.http.HttpRequestLog: Jetty request log can only be enabled using Log4j 2016-10-11 13:03:50,909 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2016-10-11 13:03:50,914 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce 2016-10-11 13:03:50,914 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static 2016-10-11 13:03:50,918 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/* 2016-10-11 13:03:50,918 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* 2016-10-11 13:03:50,927 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 42482 2016-10-11 13:03:50,927 INFO [main] org.mortbay.log: jetty-6.1.26 2016-10-11 13:03:50,961 INFO [main] org.mortbay.log: Extract jar:file:/home/c1/hadoop-2.5.2/share/hadoop/yarn/hadoop-yarn-common-2.5.2.jar!/webapps/mapreduce to /tmp/Jetty_0_0_0_0_42482_mapreduce____s33x6x/webapp 2016-10-11 13:03:51,499 INFO [main] org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:42482 2016-10-11 13:03:51,499 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at 42482 2016-10-11 13:03:51,846 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules 2016-10-11 13:03:51,851 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue 2016-10-11 13:03:51,852 INFO [Socket Reader #1 for port 44453] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 44453 2016-10-11 13:03:51,857 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2016-10-11 13:03:51,857 INFO [IPC Server listener on 44453] org.apache.hadoop.ipc.Server: IPC Server listener on 44453: starting 2016-10-11 13:03:51,874 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true 2016-10-11 13:03:51,874 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3 2016-10-11 13:03:51,874 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33 2016-10-11 13:03:51,928 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. 2016-10-11 13:03:51,933 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. 2016-10-11 13:03:51,935 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at ns613.mycyberhosting.com/95.142.101.137:8030 2016-10-11 13:03:52,032 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: maxContainerCapability: 52224 2016-10-11 13:03:52,032 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: queue: default 2016-10-11 13:03:52,036 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit on the thread pool size is 500 2016-10-11 13:03:52,037 INFO [main] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: yarn.client.max-nodemanagers-proxies : 500 2016-10-11 13:03:52,044 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1476183726669_0001Job Transitioned from INITED to SETUP 2016-10-11 13:03:52,046 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP 2016-10-11 13:03:52,059 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1476183726669_0001Job Transitioned from SETUP to RUNNING 2016-10-11 13:03:52,087 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1476183726669_0001_m_000000 Task Transitioned from NEW to SCHEDULED 2016-10-11 13:03:52,088 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1476183726669_0001_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-10-11 13:03:52,089 INFO [Thread-50] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceRequest:17408 2016-10-11 13:03:52,135 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1476183726669_0001, File: hdfs://ns613.mycyberhosting.com:54310/tmp/hadoop-yarn/staging/root/.staging/job_1476183726669_0001/job_1476183726669_0001_1.jhist 2016-10-11 13:03:53,034 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0 2016-10-11 13:03:53,090 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1476183726669_0001: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=3 2016-10-11 13:03:54,106 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-10-11 13:03:54,107 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved ns614.mycyberhosting.com to /default-rack 2016-10-11 13:03:54,109 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1476183726669_0001_01_000002 to attempt_1476183726669_0001_m_000000_0 2016-10-11 13:03:54,110 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0 2016-10-11 13:03:54,158 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved ns614.mycyberhosting.com to /default-rack 2016-10-11 13:03:54,159 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job jar is not present. Not adding any jar to the list of resources. 2016-10-11 13:03:54,174 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /tmp/hadoop-yarn/staging/root/.staging/job_1476183726669_0001/job.xml 2016-10-11 13:03:54,859 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1 tokens and #1 secret keys for NM use for launching container 2016-10-11 13:03:54,859 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 2 2016-10-11 13:03:54,859 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData 2016-10-11 13:03:56,178 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1476183726669_0001_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-10-11 13:03:56,178 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1476183726669_0001_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-10-11 13:03:56,181 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1476183726669_0001: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=3 2016-10-11 13:03:56,185 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1476183726669_0001_01_000002 taskAttempt attempt_1476183726669_0001_m_000000_0 2016-10-11 13:03:56,189 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1476183726669_0001_m_000000_0 2016-10-11 13:03:56,191 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : ns614.mycyberhosting.com:36509 2016-10-11 13:03:56,530 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1476183726669_0001_m_000000_0 : 13562 2016-10-11 13:03:56,532 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1476183726669_0001_m_000000_0] using containerId: [container_1476183726669_0001_01_000002 on NM: [ns614.mycyberhosting.com:36509] 2016-10-11 13:03:56,538 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1476183726669_0001_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-10-11 13:03:56,539 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1476183726669_0001_m_000000 Task Transitioned from SCHEDULED to RUNNING 2016-10-11 13:04:06,046 INFO [Socket Reader #1 for port 44453] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1476183726669_0001 (auth:SIMPLE) 2016-10-11 13:04:06,077 INFO [IPC Server handler 1 on 44453] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1476183726669_0001_m_000002 asked for a task 2016-10-11 13:04:06,078 INFO [IPC Server handler 1 on 44453] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1476183726669_0001_m_000002 given task: attempt_1476183726669_0001_m_000000_0 2016-10-11 13:04:07,959 INFO [IPC Server handler 1 on 44453] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1476183726669_0001_m_000000_0 is : 0.0 2016-10-11 13:04:08,060 INFO [IPC Server handler 3 on 44453] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1476183726669_0001_m_000000_0 2016-10-11 13:04:08,062 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1476183726669_0001_m_000000_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING 2016-10-11 13:04:08,062 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1476183726669_0001_m_000000_0 given a go for committing the task output. 2016-10-11 13:04:08,064 INFO [IPC Server handler 0 on 44453] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1476183726669_0001_m_000000_0 2016-10-11 13:04:08,065 INFO [IPC Server handler 0 on 44453] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1476183726669_0001_m_000000_0:true 2016-10-11 13:04:08,152 INFO [IPC Server handler 4 on 44453] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1476183726669_0001_m_000000_0 is : 1.0 2016-10-11 13:04:08,167 INFO [IPC Server handler 2 on 44453] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1476183726669_0001_m_000000_0 2016-10-11 13:04:08,169 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1476183726669_0001_m_000000_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP 2016-10-11 13:04:08,171 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1476183726669_0001_01_000002 taskAttempt attempt_1476183726669_0001_m_000000_0 2016-10-11 13:04:08,171 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1476183726669_0001_m_000000_0 2016-10-11 13:04:08,219 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1476183726669_0001_m_000000_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED 2016-10-11 13:04:08,227 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1476183726669_0001_m_000000_0 2016-10-11 13:04:08,228 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1476183726669_0001_m_000000 Task Transitioned from RUNNING to SUCCEEDED 2016-10-11 13:04:08,231 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1 2016-10-11 13:04:08,233 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1476183726669_0001Job Transitioned from RUNNING to COMMITTING 2016-10-11 13:04:08,234 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0 2016-10-11 13:04:08,234 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_COMMIT 2016-10-11 13:04:08,399 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler for JobFinishedEvent 2016-10-11 13:04:08,400 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1476183726669_0001Job Transitioned from COMMITTING to SUCCEEDED 2016-10-11 13:04:08,402 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry 2016-10-11 13:04:08,402 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true 2016-10-11 13:04:08,402 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator notified that shouldUnregistered is: true 2016-10-11 13:04:08,402 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true 2016-10-11 13:04:08,402 INFO [Thread-66] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true 2016-10-11 13:04:08,402 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services 2016-10-11 13:04:08,403 INFO [Thread-66] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0 2016-10-11 13:04:08,487 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://ns613.mycyberhosting.com:54310/tmp/hadoop-yarn/staging/root/.staging/job_1476183726669_0001/job_1476183726669_0001_1.jhist to hdfs://ns613.mycyberhosting.com:54310/tmp/hadoop-yarn/staging/history/done_intermediate/root/job_1476183726669_0001-1476183819586-root-oozie%3Alauncher%3AT%3Dshell%3AW%3Dseeds%2Dshell%2Dwf%3AA%3Dseed%2Dshe-1476183848396-1-0-SUCCEEDED-default-1476183832039.jhist_tmp 2016-10-11 13:04:08,556 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://ns613.mycyberhosting.com:54310/tmp/hadoop-yarn/staging/history/done_intermediate/root/job_1476183726669_0001-1476183819586-root-oozie%3Alauncher%3AT%3Dshell%3AW%3Dseeds%2Dshell%2Dwf%3AA%3Dseed%2Dshe-1476183848396-1-0-SUCCEEDED-default-1476183832039.jhist_tmp 2016-10-11 13:04:08,563 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://ns613.mycyberhosting.com:54310/tmp/hadoop-yarn/staging/root/.staging/job_1476183726669_0001/job_1476183726669_0001_1_conf.xml to hdfs://ns613.mycyberhosting.com:54310/tmp/hadoop-yarn/staging/history/done_intermediate/root/job_1476183726669_0001_conf.xml_tmp 2016-10-11 13:04:08,606 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://ns613.mycyberhosting.com:54310/tmp/hadoop-yarn/staging/history/done_intermediate/root/job_1476183726669_0001_conf.xml_tmp 2016-10-11 13:04:08,614 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://ns613.mycyberhosting.com:54310/tmp/hadoop-yarn/staging/history/done_intermediate/root/job_1476183726669_0001.summary_tmp to hdfs://ns613.mycyberhosting.com:54310/tmp/hadoop-yarn/staging/history/done_intermediate/root/job_1476183726669_0001.summary 2016-10-11 13:04:08,618 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://ns613.mycyberhosting.com:54310/tmp/hadoop-yarn/staging/history/done_intermediate/root/job_1476183726669_0001_conf.xml_tmp to hdfs://ns613.mycyberhosting.com:54310/tmp/hadoop-yarn/staging/history/done_intermediate/root/job_1476183726669_0001_conf.xml 2016-10-11 13:04:08,624 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://ns613.mycyberhosting.com:54310/tmp/hadoop-yarn/staging/history/done_intermediate/root/job_1476183726669_0001-1476183819586-root-oozie%3Alauncher%3AT%3Dshell%3AW%3Dseeds%2Dshell%2Dwf%3AA%3Dseed%2Dshe-1476183848396-1-0-SUCCEEDED-default-1476183832039.jhist_tmp to hdfs://ns613.mycyberhosting.com:54310/tmp/hadoop-yarn/staging/history/done_intermediate/root/job_1476183726669_0001-1476183819586-root-oozie%3Alauncher%3AT%3Dshell%3AW%3Dseeds%2Dshell%2Dwf%3AA%3Dseed%2Dshe-1476183848396-1-0-SUCCEEDED-default-1476183832039.jhist 2016-10-11 13:04:08,625 INFO [Thread-66] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop() 2016-10-11 13:04:08,629 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job diagnostics to 2016-10-11 13:04:08,630 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: History url is http://ns613.mycyberhosting.com:19888/jobhistory/job/job_1476183726669_0001 2016-10-11 13:04:08,654 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Waiting for application to be successfully unregistered. 2016-10-11 13:04:09,657 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0 2016-10-11 13:04:09,659 INFO [Thread-66] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://ns613.mycyberhosting.com:54310 /tmp/hadoop-yarn/staging/root/.staging/job_1476183726669_0001 2016-10-11 13:04:09,668 INFO [Thread-66] org.apache.hadoop.ipc.Server: Stopping server on 44453 2016-10-11 13:04:09,669 INFO [IPC Server listener on 44453] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 44453 2016-10-11 13:04:09,670 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder 2016-10-11 13:04:09,670 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted