Log Type: syslog
Log Upload Time: Fri Jul 07 07:43:15 +0000 2017
Log Length: 26301
2017-07-07 07:42:34,361 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1498477322133_0417_000001
2017-07-07 07:42:34,803 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-07-07 07:42:34,851 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2017-07-07 07:42:34,851 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 417 cluster_timestamp: 1498477322133 } attemptId: 1 } keyId: 1885330025)
2017-07-07 07:42:35,180 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: RM_DELEGATION_TOKEN, Service: 16.250.52.117:8050, Ident: (owner=ambari-qa, renewer=oozie mr token, realUser=oozie, issueDate=1499413350566, maxDate=1500018150566, sequenceNumber=1623, masterKeyId=126)
2017-07-07 07:42:35,201 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null
2017-07-07 07:42:35,202 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter
2017-07-07 07:42:36,328 WARN [main] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
2017-07-07 07:42:36,671 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
2017-07-07 07:42:36,672 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
2017-07-07 07:42:36,672 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
2017-07-07 07:42:36,673 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
2017-07-07 07:42:36,673 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
2017-07-07 07:42:36,674 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
2017-07-07 07:42:36,674 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
2017-07-07 07:42:36,675 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
2017-07-07 07:42:36,717 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore -  ignoring
2017-07-07 07:42:36,747 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore -  ignoring
2017-07-07 07:42:36,777 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore -  ignoring
2017-07-07 07:42:36,804 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job history data to the timeline server is not enabled
2017-07-07 07:42:36,845 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
2017-07-07 07:42:36,928 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties
2017-07-07 07:42:37,031 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2017-07-07 07:42:37,033 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started
2017-07-07 07:42:37,047 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1498477322133_0417 to jobTokenSecretManager
2017-07-07 07:42:37,204 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing job_1498477322133_0417 because: not enabled;
2017-07-07 07:42:37,232 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1498477322133_0417 = 0. Number of splits = 1
2017-07-07 07:42:37,232 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1498477322133_0417 = 0
2017-07-07 07:42:37,233 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1498477322133_0417Job Transitioned from NEW to INITED
2017-07-07 07:42:37,234 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, non-uberized, multi-container job job_1498477322133_0417.
2017-07-07 07:42:37,265 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler
2017-07-07 07:42:37,278 INFO [Socket Reader #1 for port 34556] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 34556
2017-07-07 07:42:37,306 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server
2017-07-07 07:42:37,307 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2017-07-07 07:42:37,309 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at [<host>]/16.250.27.9:34556
2017-07-07 07:42:37,311 INFO [IPC Server listener on 34556] org.apache.hadoop.ipc.Server: IPC Server listener on 34556: starting
2017-07-07 07:42:37,479 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2017-07-07 07:42:37,492 INFO [main] org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
2017-07-07 07:42:37,500 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.mapreduce is not defined
2017-07-07 07:42:37,512 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2017-07-07 07:42:37,521 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce
2017-07-07 07:42:37,521 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static
2017-07-07 07:42:37,527 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
2017-07-07 07:42:37,527 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
2017-07-07 07:42:38,020 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
2017-07-07 07:42:38,023 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 33307
2017-07-07 07:42:38,023 INFO [main] org.mortbay.log: jetty-6.1.26.hwx
2017-07-07 07:42:38,077 INFO [main] org.mortbay.log: Extract jar:file:/opt/mount1/hadoop/yarn/local/filecache/10/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.1.2.4.3.0-227.jar!/webapps/mapreduce to ./tmp/Jetty_0_0_0_0_33307_mapreduce____.nssish/webapp
2017-07-07 07:42:40,549 INFO [main] org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:33307
2017-07-07 07:42:40,550 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app mapreduce started at 33307
2017-07-07 07:42:40,562 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler
2017-07-07 07:42:40,564 INFO [Socket Reader #1 for port 36116] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 36116
2017-07-07 07:42:40,580 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2017-07-07 07:42:40,586 INFO [IPC Server listener on 36116] org.apache.hadoop.ipc.Server: IPC Server listener on 36116: starting
2017-07-07 07:42:40,684 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true
2017-07-07 07:42:40,685 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3
2017-07-07 07:42:40,685 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33
2017-07-07 07:42:40,772 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at [<host>]/16.250.52.117:8030
2017-07-07 07:42:40,872 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: maxContainerCapability: <memory:7936, vCores:3>
2017-07-07 07:42:40,872 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
2017-07-07 07:42:40,877 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit on the thread pool size is 500
2017-07-07 07:42:40,877 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The thread pool initial size is 10
2017-07-07 07:42:40,880 INFO [main] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0
2017-07-07 07:42:40,890 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1498477322133_0417Job Transitioned from INITED to SETUP
2017-07-07 07:42:40,901 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP
2017-07-07 07:42:40,915 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output Committer Algorithm version is 1
2017-07-07 07:42:40,915 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false
2017-07-07 07:42:40,931 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1498477322133_0417Job Transitioned from SETUP to RUNNING
2017-07-07 07:42:40,984 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1498477322133_0417_m_000000 Task Transitioned from NEW to SCHEDULED
2017-07-07 07:42:40,987 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1498477322133_0417_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED
2017-07-07 07:42:40,996 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceRequest:<memory:2048, vCores:1>
2017-07-07 07:42:41,146 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1498477322133_0417, File: hdfs://[<host>]:8020/user/ambari-qa/.staging/job_1498477322133_0417/job_1498477322133_0417_1.jhist
2017-07-07 07:42:41,876 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
2017-07-07 07:42:41,953 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1498477322133_0417: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:77824, vCores:1> knownNMs=5
2017-07-07 07:42:42,991 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
2017-07-07 07:42:43,050 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved [<host>] to /default-rack
2017-07-07 07:42:43,055 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e07_1498477322133_0417_01_000002 to attempt_1498477322133_0417_m_000000_0
2017-07-07 07:42:43,057 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
2017-07-07 07:42:43,168 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved [<host>] to /default-rack
2017-07-07 07:42:43,169 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job jar is not present. Not adding any jar to the list of resources.
2017-07-07 07:42:43,215 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /user/ambari-qa/.staging/job_1498477322133_0417/job.xml
2017-07-07 07:42:43,338 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1 tokens and #1 secret keys for NM use for launching container
2017-07-07 07:42:43,339 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 2
2017-07-07 07:42:43,339 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData
2017-07-07 07:42:43,723 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1498477322133_0417_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2017-07-07 07:42:43,729 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e07_1498477322133_0417_01_000002 taskAttempt attempt_1498477322133_0417_m_000000_0
2017-07-07 07:42:43,732 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1498477322133_0417_m_000000_0
2017-07-07 07:42:43,733 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : [<host>]:45454
2017-07-07 07:42:43,850 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1498477322133_0417_m_000000_0 : 13562
2017-07-07 07:42:43,852 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1498477322133_0417_m_000000_0] using containerId: [container_e07_1498477322133_0417_01_000002 on NM: [[<host>]]
2017-07-07 07:42:43,856 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1498477322133_0417_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
2017-07-07 07:42:43,857 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1498477322133_0417_m_000000 Task Transitioned from SCHEDULED to RUNNING
2017-07-07 07:42:44,131 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1498477322133_0417: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:75776, vCores:1> knownNMs=5
2017-07-07 07:42:48,746 INFO [Socket Reader #1 for port 36116] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1498477322133_0417 (auth:SIMPLE)
2017-07-07 07:42:48,789 INFO [IPC Server handler 0 on 36116] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1498477322133_0417_m_7696581394434 asked for a task
2017-07-07 07:42:48,791 INFO [IPC Server handler 0 on 36116] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1498477322133_0417_m_7696581394434 given task: attempt_1498477322133_0417_m_000000_0
2017-07-07 07:42:56,630 INFO [IPC Server handler 20 on 36116] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1498477322133_0417_m_000000_0 is : 1.0
2017-07-07 07:43:07,223 INFO [IPC Server handler 8 on 36116] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1498477322133_0417_m_000000_0 is : 1.0
2017-07-07 07:43:07,320 INFO [IPC Server handler 6 on 36116] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1498477322133_0417_m_000000_0
2017-07-07 07:43:07,323 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1498477322133_0417_m_000000_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING
2017-07-07 07:43:07,324 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1498477322133_0417_m_000000_0 given a go for committing the task output.
2017-07-07 07:43:07,327 INFO [IPC Server handler 9 on 36116] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1498477322133_0417_m_000000_0
2017-07-07 07:43:07,328 INFO [IPC Server handler 9 on 36116] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1498477322133_0417_m_000000_0:true
2017-07-07 07:43:07,429 INFO [IPC Server handler 10 on 36116] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1498477322133_0417_m_000000_0 is : 1.0
2017-07-07 07:43:07,440 INFO [IPC Server handler 11 on 36116] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1498477322133_0417_m_000000_0
2017-07-07 07:43:07,445 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1498477322133_0417_m_000000_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
2017-07-07 07:43:07,448 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e07_1498477322133_0417_01_000002 taskAttempt attempt_1498477322133_0417_m_000000_0
2017-07-07 07:43:07,448 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1498477322133_0417_m_000000_0
2017-07-07 07:43:07,449 INFO [ContainerLauncher #1] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : [<host>]:45454
2017-07-07 07:43:07,545 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1498477322133_0417_m_000000_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2017-07-07 07:43:07,572 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1498477322133_0417_m_000000_0
2017-07-07 07:43:07,574 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1498477322133_0417_m_000000 Task Transitioned from RUNNING to SUCCEEDED
2017-07-07 07:43:07,578 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1
2017-07-07 07:43:07,579 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1498477322133_0417Job Transitioned from RUNNING to COMMITTING
2017-07-07 07:43:07,580 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_COMMIT
2017-07-07 07:43:07,693 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler for JobFinishedEvent 
2017-07-07 07:43:07,694 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1498477322133_0417Job Transitioned from COMMITTING to SUCCEEDED
2017-07-07 07:43:07,697 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry
2017-07-07 07:43:07,698 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true
2017-07-07 07:43:07,698 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator notified that shouldUnregistered is: true
2017-07-07 07:43:07,698 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true
2017-07-07 07:43:07,698 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true
2017-07-07 07:43:07,698 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services
2017-07-07 07:43:07,701 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0
2017-07-07 07:43:07,818 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://[<host>]:8020/user/ambari-qa/.staging/job_1498477322133_0417/job_1498477322133_0417_1.jhist to hdfs://[<host>]:8020/mr-history/tmp/ambari-qa/job_1498477322133_0417-1499413351442-ambari%2Dqa-oozie%3Alauncher%3AT%3Dshell%3AW%3DShellAction%3AA%3DshellAction-1499413387688-1-0-SUCCEEDED-default-1499413360883.jhist_tmp
2017-07-07 07:43:07,886 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://[<host>]:8020/mr-history/tmp/ambari-qa/job_1498477322133_0417-1499413351442-ambari%2Dqa-oozie%3Alauncher%3AT%3Dshell%3AW%3DShellAction%3AA%3DshellAction-1499413387688-1-0-SUCCEEDED-default-1499413360883.jhist_tmp
2017-07-07 07:43:07,895 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://[<host>]:8020/user/ambari-qa/.staging/job_1498477322133_0417/job_1498477322133_0417_1_conf.xml to hdfs://[<host>]:8020/mr-history/tmp/ambari-qa/job_1498477322133_0417_conf.xml_tmp
2017-07-07 07:43:07,972 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://[<host>]:8020/mr-history/tmp/ambari-qa/job_1498477322133_0417_conf.xml_tmp
2017-07-07 07:43:07,979 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://[<host>]:8020/mr-history/tmp/ambari-qa/job_1498477322133_0417.summary_tmp to hdfs://[<host>]:8020/mr-history/tmp/ambari-qa/job_1498477322133_0417.summary
2017-07-07 07:43:07,983 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://[<host>]:8020/mr-history/tmp/ambari-qa/job_1498477322133_0417_conf.xml_tmp to hdfs://[<host>]:8020/mr-history/tmp/ambari-qa/job_1498477322133_0417_conf.xml
2017-07-07 07:43:07,987 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://[<host>]:8020/mr-history/tmp/ambari-qa/job_1498477322133_0417-1499413351442-ambari%2Dqa-oozie%3Alauncher%3AT%3Dshell%3AW%3DShellAction%3AA%3DshellAction-1499413387688-1-0-SUCCEEDED-default-1499413360883.jhist_tmp to hdfs://[<host>]:8020/mr-history/tmp/ambari-qa/job_1498477322133_0417-1499413351442-ambari%2Dqa-oozie%3Alauncher%3AT%3Dshell%3AW%3DShellAction%3AA%3DshellAction-1499413387688-1-0-SUCCEEDED-default-1499413360883.jhist
2017-07-07 07:43:07,990 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop()
2017-07-07 07:43:07,996 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job diagnostics to 
2017-07-07 07:43:07,998 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is [<host>]:19888/jobhistory/job/job_1498477322133_0417
2017-07-07 07:43:08,014 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for application to be successfully unregistered.
2017-07-07 07:43:09,018 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0
2017-07-07 07:43:09,022 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://[<host>]:8020 /user/ambari-qa/.staging/job_1498477322133_0417
2017-07-07 07:43:09,026 INFO [Thread-68] org.apache.hadoop.ipc.Server: Stopping server on 36116
2017-07-07 07:43:09,041 INFO [IPC Server listener on 36116] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 36116
2017-07-07 07:43:09,041 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
2017-07-07 07:43:09,042 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted