Logged in as: dr.who
Application

    About
    Jobs 

Tools
	

Log Type: syslog

Log Upload Time: Wed Aug 24 11:25:17 -0400 2016

Log Length: 118131

2016-08-24 11:24:20,566 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1472051594557_0001_000001
2016-08-24 11:24:20,951 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-08-24 11:24:21,042 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2016-08-24 11:24:21,042 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 1 cluster_timestamp: 1472051594557 } attemptId: 1 } keyId: -402023147)
2016-08-24 11:24:21,747 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred newApiCommitter.
2016-08-24 11:24:21,763 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null
2016-08-24 11:24:21,899 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output Committer Algorithm version is 1
2016-08-24 11:24:21,899 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false
2016-08-24 11:24:24,259 WARN [main] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
2016-08-24 11:24:24,265 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.hadoop.tools.mapred.CopyCommitter
2016-08-24 11:24:24,545 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
2016-08-24 11:24:24,546 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
2016-08-24 11:24:24,546 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
2016-08-24 11:24:24,547 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
2016-08-24 11:24:24,547 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
2016-08-24 11:24:24,550 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
2016-08-24 11:24:24,552 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
2016-08-24 11:24:24,562 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
2016-08-24 11:24:24,588 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore -  ignoring
2016-08-24 11:24:24,607 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore -  ignoring
2016-08-24 11:24:24,620 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore -  ignoring
2016-08-24 11:24:24,632 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job history data to the timeline server is not enabled
2016-08-24 11:24:24,730 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
2016-08-24 11:24:24,921 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
2016-08-24 11:24:24,973 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2016-08-24 11:24:24,973 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started
2016-08-24 11:24:24,979 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1472051594557_0001 to jobTokenSecretManager
2016-08-24 11:24:25,080 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing job_1472051594557_0001 because: not enabled;
2016-08-24 11:24:25,091 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1472051594557_0001 = 1459. Number of splits = 6
2016-08-24 11:24:25,091 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1472051594557_0001 = 0
2016-08-24 11:24:25,091 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1472051594557_0001Job Transitioned from NEW to INITED
2016-08-24 11:24:25,092 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, non-uberized, multi-container job job_1472051594557_0001.
2016-08-24 11:24:25,152 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
2016-08-24 11:24:25,159 INFO [Socket Reader #1 for port 44737] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 44737
2016-08-24 11:24:25,193 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server
2016-08-24 11:24:25,193 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2016-08-24 11:24:25,193 INFO [IPC Server listener on 44737] org.apache.hadoop.ipc.Server: IPC Server listener on 44737: starting
2016-08-24 11:24:25,195 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at hadoop1.tolls.dot.state.fl.us/10.100.44.17:44737
2016-08-24 11:24:25,492 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2016-08-24 11:24:25,498 INFO [main] org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
2016-08-24 11:24:25,501 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.mapreduce is not defined
2016-08-24 11:24:25,506 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2016-08-24 11:24:25,509 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce
2016-08-24 11:24:25,509 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static
2016-08-24 11:24:25,512 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
2016-08-24 11:24:25,512 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
2016-08-24 11:24:25,959 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
2016-08-24 11:24:25,961 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 51185
2016-08-24 11:24:25,961 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
2016-08-24 11:24:25,983 INFO [main] org.mortbay.log: Extract jar:file:/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.4.2.0-258.jar!/webapps/mapreduce to /hadoop/yarn/local/usercache/hdfs/appcache/application_1472051594557_0001/container_e05_1472051594557_0001_01_000001/tmp/Jetty_0_0_0_0_51185_mapreduce____.ajczq1/webapp
2016-08-24 11:24:27,139 INFO [main] org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:51185
2016-08-24 11:24:27,139 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app mapreduce started at 51185
2016-08-24 11:24:27,143 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
2016-08-24 11:24:27,144 INFO [Socket Reader #1 for port 51897] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 51897
2016-08-24 11:24:27,146 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2016-08-24 11:24:27,146 INFO [IPC Server listener on 51897] org.apache.hadoop.ipc.Server: IPC Server listener on 51897: starting
2016-08-24 11:24:27,217 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true
2016-08-24 11:24:27,217 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3
2016-08-24 11:24:27,217 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33
2016-08-24 11:24:27,268 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at hadoop2.tolls.dot.state.fl.us/10.100.44.16:8030
2016-08-24 11:24:27,512 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: maxContainerCapability: <memory:4096, vCores:3>
2016-08-24 11:24:27,512 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
2016-08-24 11:24:27,514 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit on the thread pool size is 500
2016-08-24 11:24:27,515 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The thread pool initial size is 10
2016-08-24 11:24:27,531 INFO [main] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0
2016-08-24 11:24:27,539 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1472051594557_0001Job Transitioned from INITED to SETUP
2016-08-24 11:24:27,540 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP
2016-08-24 11:24:27,577 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1472051594557_0001Job Transitioned from SETUP to RUNNING
2016-08-24 11:24:27,591 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000000 Task Transitioned from NEW to SCHEDULED
2016-08-24 11:24:27,592 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000001 Task Transitioned from NEW to SCHEDULED
2016-08-24 11:24:27,592 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000002 Task Transitioned from NEW to SCHEDULED
2016-08-24 11:24:27,593 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000003 Task Transitioned from NEW to SCHEDULED
2016-08-24 11:24:27,597 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000004 Task Transitioned from NEW to SCHEDULED
2016-08-24 11:24:27,597 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000005 Task Transitioned from NEW to SCHEDULED
2016-08-24 11:24:27,598 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED
2016-08-24 11:24:27,599 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000001_0 TaskAttempt Transitioned from NEW to UNASSIGNED
2016-08-24 11:24:27,602 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000002_0 TaskAttempt Transitioned from NEW to UNASSIGNED
2016-08-24 11:24:27,602 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000003_0 TaskAttempt Transitioned from NEW to UNASSIGNED
2016-08-24 11:24:27,602 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000004_0 TaskAttempt Transitioned from NEW to UNASSIGNED
2016-08-24 11:24:27,602 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000005_0 TaskAttempt Transitioned from NEW to UNASSIGNED
2016-08-24 11:24:27,604 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceRequest:<memory:1024, vCores:1>
2016-08-24 11:24:27,651 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1472051594557_0001, File: hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/hdfs/.staging/job_1472051594557_0001/job_1472051594557_0001_1.jhist
2016-08-24 11:24:28,514 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:6 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
2016-08-24 11:24:28,596 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1472051594557_0001: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:19456, vCores:1> knownNMs=5
2016-08-24 11:24:29,625 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 5
2016-08-24 11:24:29,643 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop5.tolls.dot.state.fl.us to /default-rack
2016-08-24 11:24:29,659 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop1.tolls.dot.state.fl.us to /default-rack
2016-08-24 11:24:29,673 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop4.tolls.dot.state.fl.us to /default-rack
2016-08-24 11:24:29,688 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop3.tolls.dot.state.fl.us to /default-rack
2016-08-24 11:24:29,702 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop2.tolls.dot.state.fl.us to /default-rack
2016-08-24 11:24:29,703 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e05_1472051594557_0001_01_000002 to attempt_1472051594557_0001_m_000000_0
2016-08-24 11:24:29,703 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e05_1472051594557_0001_01_000003 to attempt_1472051594557_0001_m_000001_0
2016-08-24 11:24:29,704 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e05_1472051594557_0001_01_000004 to attempt_1472051594557_0001_m_000002_0
2016-08-24 11:24:29,704 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e05_1472051594557_0001_01_000005 to attempt_1472051594557_0001_m_000003_0
2016-08-24 11:24:29,704 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e05_1472051594557_0001_01_000006 to attempt_1472051594557_0001_m_000004_0
2016-08-24 11:24:29,704 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:5 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:5 ContRel:0 HostLocal:0 RackLocal:0
2016-08-24 11:24:29,778 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop5.tolls.dot.state.fl.us to /default-rack
2016-08-24 11:24:29,868 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar file on the remote FS is hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/hdfs/.staging/job_1472051594557_0001/job.jar
2016-08-24 11:24:29,870 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /user/hdfs/.staging/job_1472051594557_0001/job.xml
2016-08-24 11:24:29,871 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0 tokens and #1 secret keys for NM use for launching container
2016-08-24 11:24:29,871 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 1
2016-08-24 11:24:29,871 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData
2016-08-24 11:24:29,955 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2016-08-24 11:24:29,957 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop1.tolls.dot.state.fl.us to /default-rack
2016-08-24 11:24:29,957 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000001_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2016-08-24 11:24:29,958 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop4.tolls.dot.state.fl.us to /default-rack
2016-08-24 11:24:29,958 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000002_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2016-08-24 11:24:29,958 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop3.tolls.dot.state.fl.us to /default-rack
2016-08-24 11:24:29,958 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000003_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2016-08-24 11:24:29,959 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop2.tolls.dot.state.fl.us to /default-rack
2016-08-24 11:24:29,959 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000004_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2016-08-24 11:24:29,960 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e05_1472051594557_0001_01_000002 taskAttempt attempt_1472051594557_0001_m_000000_0
2016-08-24 11:24:29,962 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e05_1472051594557_0001_01_000003 taskAttempt attempt_1472051594557_0001_m_000001_0
2016-08-24 11:24:29,962 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e05_1472051594557_0001_01_000004 taskAttempt attempt_1472051594557_0001_m_000002_0
2016-08-24 11:24:29,963 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e05_1472051594557_0001_01_000005 taskAttempt attempt_1472051594557_0001_m_000003_0
2016-08-24 11:24:29,963 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1472051594557_0001_m_000000_0
2016-08-24 11:24:29,963 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1472051594557_0001_m_000001_0
2016-08-24 11:24:29,963 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1472051594557_0001_m_000003_0
2016-08-24 11:24:29,964 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e05_1472051594557_0001_01_000006 taskAttempt attempt_1472051594557_0001_m_000004_0
2016-08-24 11:24:29,964 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1472051594557_0001_m_000004_0
2016-08-24 11:24:29,964 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1472051594557_0001_m_000002_0
2016-08-24 11:24:29,964 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop5.tolls.dot.state.fl.us:45454
2016-08-24 11:24:30,002 INFO [ContainerLauncher #2] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop4.tolls.dot.state.fl.us:45454
2016-08-24 11:24:30,004 INFO [ContainerLauncher #4] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop2.tolls.dot.state.fl.us:45454
2016-08-24 11:24:30,005 INFO [ContainerLauncher #3] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop3.tolls.dot.state.fl.us:45454
2016-08-24 11:24:30,005 INFO [ContainerLauncher #1] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop1.tolls.dot.state.fl.us:45454
2016-08-24 11:24:30,066 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1472051594557_0001_m_000001_0 : 13562
2016-08-24 11:24:30,066 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1472051594557_0001_m_000002_0 : 13562
2016-08-24 11:24:30,068 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1472051594557_0001_m_000001_0] using containerId: [container_e05_1472051594557_0001_01_000003 on NM: [hadoop1.tolls.dot.state.fl.us:45454]
2016-08-24 11:24:30,070 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000001_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
2016-08-24 11:24:30,071 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1472051594557_0001_m_000002_0] using containerId: [container_e05_1472051594557_0001_01_000004 on NM: [hadoop4.tolls.dot.state.fl.us:45454]
2016-08-24 11:24:30,071 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000002_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
2016-08-24 11:24:30,071 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000001 Task Transitioned from SCHEDULED to RUNNING
2016-08-24 11:24:30,071 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000002 Task Transitioned from SCHEDULED to RUNNING
2016-08-24 11:24:30,073 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1472051594557_0001_m_000003_0 : 13562
2016-08-24 11:24:30,074 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1472051594557_0001_m_000000_0 : 13562
2016-08-24 11:24:30,077 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1472051594557_0001_m_000003_0] using containerId: [container_e05_1472051594557_0001_01_000005 on NM: [hadoop3.tolls.dot.state.fl.us:45454]
2016-08-24 11:24:30,078 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000003_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
2016-08-24 11:24:30,078 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1472051594557_0001_m_000000_0] using containerId: [container_e05_1472051594557_0001_01_000002 on NM: [hadoop5.tolls.dot.state.fl.us:45454]
2016-08-24 11:24:30,078 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
2016-08-24 11:24:30,078 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000003 Task Transitioned from SCHEDULED to RUNNING
2016-08-24 11:24:30,078 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000000 Task Transitioned from SCHEDULED to RUNNING
2016-08-24 11:24:30,194 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1472051594557_0001_m_000004_0 : 13562
2016-08-24 11:24:30,194 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1472051594557_0001_m_000004_0] using containerId: [container_e05_1472051594557_0001_01_000006 on NM: [hadoop2.tolls.dot.state.fl.us:45454]
2016-08-24 11:24:30,194 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000004_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
2016-08-24 11:24:30,194 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000004 Task Transitioned from SCHEDULED to RUNNING
2016-08-24 11:24:30,710 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1472051594557_0001: ask=1 release= 0 newContainers=1 finishedContainers=0 resourcelimit=<memory:13312, vCores:1> knownNMs=5
2016-08-24 11:24:30,710 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
2016-08-24 11:24:30,710 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop5.tolls.dot.state.fl.us to /default-rack
2016-08-24 11:24:30,710 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e05_1472051594557_0001_01_000007 to attempt_1472051594557_0001_m_000005_0
2016-08-24 11:24:30,711 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:6 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:6 ContRel:0 HostLocal:0 RackLocal:0
2016-08-24 11:24:30,711 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop5.tolls.dot.state.fl.us to /default-rack
2016-08-24 11:24:30,711 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000005_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2016-08-24 11:24:30,714 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e05_1472051594557_0001_01_000007 taskAttempt attempt_1472051594557_0001_m_000005_0
2016-08-24 11:24:30,714 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1472051594557_0001_m_000005_0
2016-08-24 11:24:30,714 INFO [ContainerLauncher #5] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop5.tolls.dot.state.fl.us:45454
2016-08-24 11:24:30,728 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1472051594557_0001_m_000005_0 : 13562
2016-08-24 11:24:30,728 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1472051594557_0001_m_000005_0] using containerId: [container_e05_1472051594557_0001_01_000007 on NM: [hadoop5.tolls.dot.state.fl.us:45454]
2016-08-24 11:24:30,728 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000005_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
2016-08-24 11:24:30,728 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000005 Task Transitioned from SCHEDULED to RUNNING
2016-08-24 11:24:31,276 INFO [Socket Reader #1 for port 51897] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1472051594557_0001 (auth:SIMPLE)
2016-08-24 11:24:31,291 INFO [IPC Server handler 1 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1472051594557_0001_m_5497558138883 asked for a task
2016-08-24 11:24:31,291 INFO [IPC Server handler 1 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1472051594557_0001_m_5497558138883 given task: attempt_1472051594557_0001_m_000001_0
2016-08-24 11:24:31,499 INFO [Socket Reader #1 for port 51897] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1472051594557_0001 (auth:SIMPLE)
2016-08-24 11:24:31,508 INFO [Socket Reader #1 for port 51897] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1472051594557_0001 (auth:SIMPLE)
2016-08-24 11:24:31,513 INFO [IPC Server handler 3 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1472051594557_0001_m_5497558138884 asked for a task
2016-08-24 11:24:31,513 INFO [IPC Server handler 3 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1472051594557_0001_m_5497558138884 given task: attempt_1472051594557_0001_m_000002_0
2016-08-24 11:24:31,518 INFO [IPC Server handler 4 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1472051594557_0001_m_5497558138885 asked for a task
2016-08-24 11:24:31,518 INFO [IPC Server handler 4 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1472051594557_0001_m_5497558138885 given task: attempt_1472051594557_0001_m_000003_0
2016-08-24 11:24:31,722 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1472051594557_0001: ask=1 release= 0 newContainers=1 finishedContainers=0 resourcelimit=<memory:12288, vCores:1> knownNMs=5
2016-08-24 11:24:31,722 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
2016-08-24 11:24:31,723 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Cannot assign container Container: [ContainerId: container_e05_1472051594557_0001_01_000008, NodeId: hadoop5.tolls.dot.state.fl.us:45454, NodeHttpAddress: hadoop5.tolls.dot.state.fl.us:8042, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.100.44.20:45454 }, ] for a map as either  container memory less than required <memory:1024, vCores:1> or no pending map tasks - maps.isEmpty=true
2016-08-24 11:24:31,723 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:6 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:7 ContRel:1 HostLocal:0 RackLocal:0
2016-08-24 11:24:32,115 INFO [Socket Reader #1 for port 51897] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1472051594557_0001 (auth:SIMPLE)
2016-08-24 11:24:32,138 INFO [IPC Server handler 5 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1472051594557_0001_m_5497558138882 asked for a task
2016-08-24 11:24:32,138 INFO [IPC Server handler 5 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1472051594557_0001_m_5497558138882 given task: attempt_1472051594557_0001_m_000000_0
2016-08-24 11:24:32,367 INFO [IPC Server handler 3 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1472051594557_0001_m_000003_0 is : 0.0
2016-08-24 11:24:32,430 INFO [IPC Server handler 4 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1472051594557_0001_m_000002_0 is : 0.0
2016-08-24 11:24:32,591 INFO [IPC Server handler 5 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1472051594557_0001_m_000002_0
2016-08-24 11:24:32,592 INFO [IPC Server handler 2 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1472051594557_0001_m_000002_0
2016-08-24 11:24:32,593 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000002_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING
2016-08-24 11:24:32,593 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1472051594557_0001_m_000002_0 given a go for committing the task output.
2016-08-24 11:24:32,631 INFO [IPC Server handler 0 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1472051594557_0001_m_000003_0
2016-08-24 11:24:32,631 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000003_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING
2016-08-24 11:24:32,631 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1472051594557_0001_m_000003_0 given a go for committing the task output.
2016-08-24 11:24:32,632 INFO [IPC Server handler 7 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1472051594557_0001_m_000003_0
2016-08-24 11:24:32,632 INFO [IPC Server handler 7 on 51897] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1472051594557_0001_m_000003_0:true
2016-08-24 11:24:32,662 INFO [IPC Server handler 8 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1472051594557_0001_m_000003_0 is : 1.0
2016-08-24 11:24:32,668 INFO [IPC Server handler 9 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1472051594557_0001_m_000003_0
2016-08-24 11:24:32,669 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000003_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
2016-08-24 11:24:32,671 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e05_1472051594557_0001_01_000005 taskAttempt attempt_1472051594557_0001_m_000003_0
2016-08-24 11:24:32,672 INFO [ContainerLauncher #6] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1472051594557_0001_m_000003_0
2016-08-24 11:24:32,672 INFO [ContainerLauncher #6] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop3.tolls.dot.state.fl.us:45454
2016-08-24 11:24:32,703 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000003_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2016-08-24 11:24:32,707 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1472051594557_0001_m_000003_0
2016-08-24 11:24:32,708 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000003 Task Transitioned from RUNNING to SUCCEEDED
2016-08-24 11:24:32,709 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1
2016-08-24 11:24:32,723 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:6 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:7 ContRel:1 HostLocal:0 RackLocal:0
2016-08-24 11:24:32,736 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1472051594557_0001: ask=0 release= 1 newContainers=0 finishedContainers=1 resourcelimit=<memory:13312, vCores:1> knownNMs=5
2016-08-24 11:24:32,736 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e05_1472051594557_0001_01_000008
2016-08-24 11:24:32,736 ERROR [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Container complete event for unknown container id container_e05_1472051594557_0001_01_000008
2016-08-24 11:24:32,884 INFO [Socket Reader #1 for port 51897] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1472051594557_0001 (auth:SIMPLE)
2016-08-24 11:24:32,900 INFO [IPC Server handler 11 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1472051594557_0001_m_5497558138887 asked for a task
2016-08-24 11:24:32,900 INFO [IPC Server handler 11 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1472051594557_0001_m_5497558138887 given task: attempt_1472051594557_0001_m_000005_0
2016-08-24 11:24:33,593 INFO [IPC Server handler 0 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1472051594557_0001_m_000002_0
2016-08-24 11:24:33,594 INFO [IPC Server handler 0 on 51897] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1472051594557_0001_m_000002_0:true
2016-08-24 11:24:33,630 INFO [IPC Server handler 7 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1472051594557_0001_m_000002_0 is : 1.0
2016-08-24 11:24:33,633 INFO [IPC Server handler 8 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1472051594557_0001_m_000002_0
2016-08-24 11:24:33,634 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000002_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
2016-08-24 11:24:33,634 INFO [ContainerLauncher #7] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e05_1472051594557_0001_01_000004 taskAttempt attempt_1472051594557_0001_m_000002_0
2016-08-24 11:24:33,634 INFO [ContainerLauncher #7] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1472051594557_0001_m_000002_0
2016-08-24 11:24:33,634 INFO [ContainerLauncher #7] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop4.tolls.dot.state.fl.us:45454
2016-08-24 11:24:33,643 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000002_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2016-08-24 11:24:33,643 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1472051594557_0001_m_000002_0
2016-08-24 11:24:33,643 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000002 Task Transitioned from RUNNING to SUCCEEDED
2016-08-24 11:24:33,643 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 2
2016-08-24 11:24:33,737 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:6 AssignedReds:0 CompletedMaps:2 CompletedReds:0 ContAlloc:7 ContRel:1 HostLocal:0 RackLocal:0
2016-08-24 11:24:33,739 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e05_1472051594557_0001_01_000004
2016-08-24 11:24:33,740 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e05_1472051594557_0001_01_000005
2016-08-24 11:24:33,740 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1472051594557_0001_m_000002_0: Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2016-08-24 11:24:33,740 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:4 AssignedReds:0 CompletedMaps:2 CompletedReds:0 ContAlloc:7 ContRel:1 HostLocal:0 RackLocal:0
2016-08-24 11:24:33,740 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1472051594557_0001_m_000003_0: Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2016-08-24 11:24:33,845 INFO [IPC Server handler 11 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1472051594557_0001_m_000000_0 is : 0.0
2016-08-24 11:24:34,088 INFO [IPC Server handler 12 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1472051594557_0001_m_000000_0
2016-08-24 11:24:34,090 INFO [IPC Server handler 6 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1472051594557_0001_m_000000_0
2016-08-24 11:24:34,091 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000000_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING
2016-08-24 11:24:34,091 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1472051594557_0001_m_000000_0 given a go for committing the task output.
2016-08-24 11:24:34,321 INFO [IPC Server handler 3 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1472051594557_0001_m_000005_0 is : 0.0
2016-08-24 11:24:34,464 INFO [IPC Server handler 5 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1472051594557_0001_m_000005_0
2016-08-24 11:24:34,464 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000005_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING
2016-08-24 11:24:34,465 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1472051594557_0001_m_000005_0 given a go for committing the task output.
2016-08-24 11:24:34,465 INFO [IPC Server handler 2 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1472051594557_0001_m_000005_0
2016-08-24 11:24:34,465 INFO [IPC Server handler 2 on 51897] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1472051594557_0001_m_000005_0:true
2016-08-24 11:24:34,491 INFO [IPC Server handler 0 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1472051594557_0001_m_000005_0 is : 1.0
2016-08-24 11:24:34,494 INFO [IPC Server handler 7 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1472051594557_0001_m_000005_0
2016-08-24 11:24:34,495 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000005_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
2016-08-24 11:24:34,495 INFO [ContainerLauncher #8] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e05_1472051594557_0001_01_000007 taskAttempt attempt_1472051594557_0001_m_000005_0
2016-08-24 11:24:34,495 INFO [ContainerLauncher #8] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1472051594557_0001_m_000005_0
2016-08-24 11:24:34,495 INFO [ContainerLauncher #8] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop5.tolls.dot.state.fl.us:45454
2016-08-24 11:24:34,504 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000005_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2016-08-24 11:24:34,504 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1472051594557_0001_m_000005_0
2016-08-24 11:24:34,504 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000005 Task Transitioned from RUNNING to SUCCEEDED
2016-08-24 11:24:34,504 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 3
2016-08-24 11:24:34,740 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:4 AssignedReds:0 CompletedMaps:3 CompletedReds:0 ContAlloc:7 ContRel:1 HostLocal:0 RackLocal:0
2016-08-24 11:24:34,741 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e05_1472051594557_0001_01_000007
2016-08-24 11:24:34,742 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:3 CompletedReds:0 ContAlloc:7 ContRel:1 HostLocal:0 RackLocal:0
2016-08-24 11:24:34,742 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1472051594557_0001_m_000005_0: Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2016-08-24 11:24:35,092 INFO [IPC Server handler 10 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1472051594557_0001_m_000000_0
2016-08-24 11:24:35,092 INFO [IPC Server handler 10 on 51897] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1472051594557_0001_m_000000_0:true
2016-08-24 11:24:35,118 INFO [IPC Server handler 13 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1472051594557_0001_m_000000_0 is : 1.0
2016-08-24 11:24:35,120 INFO [IPC Server handler 15 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1472051594557_0001_m_000000_0
2016-08-24 11:24:35,121 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000000_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
2016-08-24 11:24:35,122 INFO [ContainerLauncher #9] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e05_1472051594557_0001_01_000002 taskAttempt attempt_1472051594557_0001_m_000000_0
2016-08-24 11:24:35,122 INFO [ContainerLauncher #9] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1472051594557_0001_m_000000_0
2016-08-24 11:24:35,122 INFO [ContainerLauncher #9] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop5.tolls.dot.state.fl.us:45454
2016-08-24 11:24:35,135 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000000_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2016-08-24 11:24:35,135 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1472051594557_0001_m_000000_0
2016-08-24 11:24:35,135 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1472051594557_0001_m_000000 Task Transitioned from RUNNING to SUCCEEDED
2016-08-24 11:24:35,136 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 4
2016-08-24 11:24:35,742 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:3 AssignedReds:0 CompletedMaps:4 CompletedReds:0 ContAlloc:7 ContRel:1 HostLocal:0 RackLocal:0
2016-08-24 11:24:35,744 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e05_1472051594557_0001_01_000002
2016-08-24 11:24:35,744 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:2 AssignedReds:0 CompletedMaps:4 CompletedReds:0 ContAlloc:7 ContRel:1 HostLocal:0 RackLocal:0
2016-08-24 11:24:35,744 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1472051594557_0001_m_000000_0: Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2016-08-24 11:24:37,931 INFO [IPC Server handler 6 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1472051594557_0001_m_000001_0 is : 1.0
2016-08-24 11:24:38,202 INFO [IPC Server handler 1 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1472051594557_0001_m_000001_0 is : 1.0
2016-08-24 11:24:38,207 FATAL [IPC Server handler 3 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1472051594557_0001_m_000001_0 - exited : java.io.IOException: File copy failed: hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/sami/error1.log --> hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/zhang/sami/error1.log
	at org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:285)
	at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:253)
	at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:50)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.io.IOException: Couldn't run retriable-command: Copying hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/sami/error1.log to hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/zhang/sami/error1.log
	at org.apache.hadoop.tools.util.RetriableCommand.execute(RetriableCommand.java:101)
	at org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:281)
	... 10 more
Caused by: java.io.IOException: Check-sum mismatch between hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/sami/error1.log and hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/zhang/.distcp.tmp.attempt_1472051594557_0001_m_000001_0. Source and target differ in block-size. Use -pb to preserve block-sizes during copy. Alternatively, skip checksum-checks altogether, using -skipCrc. (NOTE: By skipping checksums, one runs the risk of masking data-corruption during file-transfer.)
	at org.apache.hadoop.tools.mapred.RetriableFileCopyCommand.compareCheckSums(RetriableFileCopyCommand.java:210)
	at org.apache.hadoop.tools.mapred.RetriableFileCopyCommand.doCopy(RetriableFileCopyCommand.java:130)
	at org.apache.hadoop.tools.mapred.RetriableFileCopyCommand.doExecute(RetriableFileCopyCommand.java:99)
	at org.apache.hadoop.tools.util.RetriableCommand.execute(RetriableCommand.java:87)
	... 11 more

2016-08-24 11:24:38,207 INFO [IPC Server handler 3 on 51897] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1472051594557_0001_m_000001_0: Error: java.io.IOException: File copy failed: hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/sami/error1.log --> hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/zhang/sami/error1.log
	at org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:285)
	at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:253)
	at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:50)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.io.IOException: Couldn't run retriable-command: Copying hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/sami/error1.log to hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/zhang/sami/error1.log
	at org.apache.hadoop.tools.util.RetriableCommand.execute(RetriableCommand.java:101)
	at org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:281)
	... 10 more
Caused by: java.io.IOException: Check-sum mismatch between hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/sami/error1.log and hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/zhang/.distcp.tmp.attempt_1472051594557_0001_m_000001_0. Source and target differ in block-size. Use -pb to preserve block-sizes during copy. Alternatively, skip checksum-checks altogether, using -skipCrc. (NOTE: By skipping checksums, one runs the risk of masking data-corruption during file-transfer.)
	at org.apache.hadoop.tools.mapred.RetriableFileCopyCommand.compareCheckSums(RetriableFileCopyCommand.java:210)
	at org.apache.hadoop.tools.mapred.RetriableFileCopyCommand.doCopy(RetriableFileCopyCommand.java:130)
	at org.apache.hadoop.tools.mapred.RetriableFileCopyCommand.doExecute(RetriableFileCopyCommand.java:99)
	at org.apache.hadoop.tools.util.RetriableCommand.execute(RetriableCommand.java:87)
	... 11 more

2016-08-24 11:24:38,207 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1472051594557_0001_m_000001_0: Error: java.io.IOException: File copy failed: hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/sami/error1.log --> hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/zhang/sami/error1.log
	at org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:285)
	at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:253)
	at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:50)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.io.IOException: Couldn't run retriable-command: Copying hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/sami/error1.log to hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/zhang/sami/error1.log
	at org.apache.hadoop.tools.util.RetriableCommand.execute(RetriableCommand.java:101)
	at org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:281)
	... 10 more
Caused by: java.io.IOException: Check-sum mismatch between hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/sami/error1.log and hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/zhang/.distcp.tmp.attempt_1472051594557_0001_m_000001_0. Source and target differ in block-size. Use -pb to preserve block-sizes during copy. Alternatively, skip checksum-checks altogether, using -skipCrc. (NOTE: By skipping checksums, one runs the risk of masking data-corruption during file-transfer.)
	at org.apache.hadoop.tools.mapred.RetriableFileCopyCommand.compareCheckSums(RetriableFileCopyCommand.java:210)
	at org.apache.hadoop.tools.mapred.RetriableFileCopyCommand.doCopy(RetriableFileCopyCommand.java:130)
	at org.apache.hadoop.tools.mapred.RetriableFileCopyCommand.doExecute(RetriableFileCopyCommand.java:99)
	at org.apache.hadoop.tools.util.RetriableCommand.execute(RetriableCommand.java:87)
	... 11 more

2016-08-24 11:24:38,208 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000001_0 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP
2016-08-24 11:24:38,208 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e05_1472051594557_0001_01_000003 taskAttempt attempt_1472051594557_0001_m_000001_0
2016-08-24 11:24:38,209 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1472051594557_0001_m_000001_0
2016-08-24 11:24:38,209 INFO [ContainerLauncher #1] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop1.tolls.dot.state.fl.us:45454
2016-08-24 11:24:38,229 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000001_0 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP
2016-08-24 11:24:38,230 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT
2016-08-24 11:24:38,237 WARN [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete hdfs://hadoop1.tolls.dot.state.fl.us:8020/user/hdfs/.staging/_distcp1075131397/_logs/_temporary/1/_temporary/attempt_1472051594557_0001_m_000001_0
2016-08-24 11:24:38,237 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000001_0 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED
2016-08-24 11:24:38,238 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000001_1 TaskAttempt Transitioned from NEW to UNASSIGNED
2016-08-24 11:24:38,240 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 1 failures on node hadoop1.tolls.dot.state.fl.us
2016-08-24 11:24:38,240 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Added attempt_1472051594557_0001_m_000001_1 to list of failed maps
2016-08-24 11:24:38,747 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:2 AssignedReds:0 CompletedMaps:4 CompletedReds:0 ContAlloc:7 ContRel:1 HostLocal:0 RackLocal:0
2016-08-24 11:24:38,750 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1472051594557_0001: ask=1 release= 0 newContainers=0 finishedContainers=1 resourcelimit=<memory:18432, vCores:1> knownNMs=5
2016-08-24 11:24:38,750 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e05_1472051594557_0001_01_000003
2016-08-24 11:24:38,750 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:4 CompletedReds:0 ContAlloc:7 ContRel:1 HostLocal:0 RackLocal:0
2016-08-24 11:24:38,750 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1472051594557_0001_m_000001_0: Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2016-08-24 11:24:39,757 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
2016-08-24 11:24:39,757 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigning container Container: [ContainerId: container_e05_1472051594557_0001_01_000009, NodeId: hadoop5.tolls.dot.state.fl.us:45454, NodeHttpAddress: hadoop5.tolls.dot.state.fl.us:8042, Resource: <memory:1024, vCores:1>, Priority: 5, Token: Token { kind: ContainerToken, service: 10.100.44.20:45454 }, ] to fast fail map
2016-08-24 11:24:39,757 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned from earlierFailedMaps
2016-08-24 11:24:39,757 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e05_1472051594557_0001_01_000009 to attempt_1472051594557_0001_m_000001_1
2016-08-24 11:24:39,757 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:2 AssignedReds:0 CompletedMaps:4 CompletedReds:0 ContAlloc:8 ContRel:1 HostLocal:0 RackLocal:0
2016-08-24 11:24:39,757 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop5.tolls.dot.state.fl.us to /default-rack
2016-08-24 11:24:39,758 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1472051594557_0001_m_000001_1 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2016-08-24 11:24:39,758 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e05_1472051594557_0001_01_000009 taskAttempt attempt_1472051594557_0001_m_000001_1
2016-08-24 11:24:39,758 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1472051594557_0001_m_000001_1
2016-08-24 11:24:39,758 INFO [ContainerLauncher #2] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : hadoop5.tolls.dot.state.fl.us:45454
2016-08-24 11:24:39,771 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1472051594557_0001_m_000001_1 : 13562
2016-08-24 11:24:39,771 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduc