Log Type: syslog Log Upload Time: Thu Oct 27 11:43:13 +0300 2016 Log Length: 41014 2016-10-27 11:42:53,408 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1477324998079_0488_000001 2016-10-27 11:42:53,583 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2016-10-27 11:42:53,618 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens: 2016-10-27 11:42:53,618 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 488 cluster_timestamp: 1477324998079 } attemptId: 1 } keyId: 1839981946) 2016-10-27 11:42:53,827 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: RM_DELEGATION_TOKEN, Service: 10.6.102.33:8050, Ident: (owner=apiminov, renewer=oozie mr token, realUser=oozie, issueDate=1477557771346, maxDate=1478162571346, sequenceNumber=207, masterKeyId=71) 2016-10-27 11:42:53,842 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null 2016-10-27 11:42:53,843 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.hadoop.mapred.FileOutputCommitter 2016-10-27 11:42:54,350 WARN [main] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. 2016-10-27 11:42:54,486 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler 2016-10-27 11:42:54,487 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher 2016-10-27 11:42:54,488 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher 2016-10-27 11:42:54,488 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher 2016-10-27 11:42:54,489 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler 2016-10-27 11:42:54,489 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher 2016-10-27 11:42:54,489 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter 2016-10-27 11:42:54,490 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter 2016-10-27 11:42:54,513 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore - ignoring 2016-10-27 11:42:54,529 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore - ignoring 2016-10-27 11:42:54,544 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system is set solely by core-default.xml therefore - ignoring 2016-10-27 11:42:54,557 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job history data to the timeline server is not enabled 2016-10-27 11:42:54,584 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler 2016-10-27 11:42:54,631 WARN [main] org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-mrappmaster.properties,hadoop-metrics2.properties 2016-10-27 11:42:54,683 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2016-10-27 11:42:54,683 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started 2016-10-27 11:42:54,690 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1477324998079_0488 to jobTokenSecretManager 2016-10-27 11:42:54,790 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing job_1477324998079_0488 because: not enabled; 2016-10-27 11:42:54,806 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1477324998079_0488 = 0. Number of splits = 1 2016-10-27 11:42:54,806 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1477324998079_0488 = 0 2016-10-27 11:42:54,806 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1477324998079_0488Job Transitioned from NEW to INITED 2016-10-27 11:42:54,807 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, non-uberized, multi-container job job_1477324998079_0488. 2016-10-27 11:42:54,824 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2016-10-27 11:42:54,832 INFO [Socket Reader #1 for port 45092] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 45092 2016-10-27 11:42:54,847 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server 2016-10-27 11:42:54,848 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2016-10-27 11:42:54,848 INFO [IPC Server listener on 45092] org.apache.hadoop.ipc.Server: IPC Server listener on 45092: starting 2016-10-27 11:42:54,848 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at /10.6.102.33:45092 2016-10-27 11:42:54,848 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at /10.6.102.33:45092 2016-10-27 11:42:54,915 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2016-10-27 11:42:54,922 INFO [main] org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2016-10-27 11:42:54,926 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.mapreduce is not defined 2016-10-27 11:42:54,931 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2016-10-27 11:42:54,936 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce 2016-10-27 11:42:54,936 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static 2016-10-27 11:42:54,939 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/* 2016-10-27 11:42:54,939 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* 2016-10-27 11:42:55,155 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules 2016-10-27 11:42:55,156 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 34568 2016-10-27 11:42:55,156 INFO [main] org.mortbay.log: jetty-6.1.26.hwx 2016-10-27 11:42:55,181 INFO [main] org.mortbay.log: Extract jar:file:/hadoop/hadoop/yarn/local/filecache/16/mapreduce.tar.gz/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.7.3.2.5.0.0-1245.jar!/webapps/mapreduce to ./tmp/Jetty_0_0_0_0_34568_mapreduce____.j4v0ot/webapp 2016-10-27 11:42:55,991 INFO [main] org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:34568 2016-10-27 11:42:55,992 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app mapreduce started at 34568 2016-10-27 11:42:55,995 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue scheduler: class org.apache.hadoop.ipc.DefaultRpcScheduler 2016-10-27 11:42:55,995 INFO [Socket Reader #1 for port 34544] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 34544 2016-10-27 11:42:55,998 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting 2016-10-27 11:42:55,998 INFO [IPC Server listener on 34544] org.apache.hadoop.ipc.Server: IPC Server listener on 34544: starting 2016-10-27 11:42:56,014 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true 2016-10-27 11:42:56,014 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3 2016-10-27 11:42:56,014 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33 2016-10-27 11:42:56,046 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at /10.6.102.33:8030 2016-10-27 11:42:56,101 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: maxContainerCapability: 2016-10-27 11:42:56,101 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default 2016-10-27 11:42:56,105 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit on the thread pool size is 500 2016-10-27 11:42:56,105 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The thread pool initial size is 10 2016-10-27 11:42:56,108 INFO [main] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 2016-10-27 11:42:56,112 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1477324998079_0488Job Transitioned from INITED to SETUP 2016-10-27 11:42:56,113 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP 2016-10-27 11:42:56,115 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output Committer Algorithm version is 1 2016-10-27 11:42:56,115 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false 2016-10-27 11:42:56,192 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1477324998079_0488Job Transitioned from SETUP to RUNNING 2016-10-27 11:42:56,207 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1477324998079_0488, File: hdfs://:8020/user/apiminov/.staging/job_1477324998079_0488/job_1477324998079_0488_1.jhist 2016-10-27 11:42:56,209 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1477324998079_0488_m_000000 Task Transitioned from NEW to SCHEDULED 2016-10-27 11:42:56,209 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1477324998079_0488_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED 2016-10-27 11:42:56,210 INFO [Thread-52] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceRequest: 2016-10-27 11:42:57,104 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:1 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0 2016-10-27 11:42:57,131 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1477324998079_0488: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=2 2016-10-27 11:42:58,139 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1 2016-10-27 11:42:58,160 INFO [RMCommunicator Allocator] org.apache.hadoop.yarn.util.RackResolver: Resolved to /default-rack 2016-10-27 11:42:58,162 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_e23_1477324998079_0488_01_000002 to attempt_1477324998079_0488_m_000000_0 2016-10-27 11:42:58,163 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0 2016-10-27 11:42:58,196 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved to /default-rack 2016-10-27 11:42:58,196 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Job jar is not present. Not adding any jar to the list of resources. 2016-10-27 11:42:58,212 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /user/apiminov/.staging/job_1477324998079_0488/job.xml 2016-10-27 11:42:58,234 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/aws-java-sdk-s3-1.10.6.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/aws-java-sdk-s3-1.10.6.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,235 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/snappy-java-1.1.1.3.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/snappy-java-1.1.1.3.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,236 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/commons-lang3-3.3.2.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/commons-lang3-3.3.2.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,237 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/jackson-databind-2.4.4.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/jackson-databind-2.4.4.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,237 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/oozie-sharelib-sqoop-4.2.0.2.5.0.0-1245.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/oozie-sharelib-sqoop-4.2.0.2.5.0.0-1245.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,238 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/azure-storage-2.2.0.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/azure-storage-2.2.0.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,239 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/sqoop-1.4.6.2.5.0.0-1245.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/sqoop-1.4.6.2.5.0.0-1245.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,239 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/aws-java-sdk-core-1.10.6.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/aws-java-sdk-core-1.10.6.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,240 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/guava-11.0.2.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/guava-11.0.2.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,241 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/xz-1.5.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/xz-1.5.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,241 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/joda-time-2.1.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/joda-time-2.1.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,242 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/avro-1.8.0.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/avro-1.8.0.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,242 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/commons-compress-1.8.1.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/commons-compress-1.8.1.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,243 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/paranamer-2.7.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/paranamer-2.7.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,243 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/hadoop-azure-2.7.3.2.5.0.0-1245.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/hadoop-azure-2.7.3.2.5.0.0-1245.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,244 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/hsqldb-1.8.0.7.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/hsqldb-1.8.0.7.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,244 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/aws-java-sdk-kms-1.10.6.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/aws-java-sdk-kms-1.10.6.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,245 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/sqljdbc4.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/sqljdbc4.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,246 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/commons-io-2.4.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/commons-io-2.4.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,246 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/hadoop-aws-2.7.3.2.5.0.0-1245.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/hadoop-aws-2.7.3.2.5.0.0-1245.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,247 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/jackson-annotations-2.4.0.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/jackson-annotations-2.4.0.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,247 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/jackson-core-2.4.4.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/jackson-core-2.4.4.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,248 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/ojdbc6.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/sqoop/ojdbc6.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,249 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/aws-java-sdk-core-1.10.6.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/oozie/aws-java-sdk-core-1.10.6.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,249 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/aws-java-sdk-kms-1.10.6.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/oozie/aws-java-sdk-kms-1.10.6.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,250 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/aws-java-sdk-s3-1.10.6.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/oozie/aws-java-sdk-s3-1.10.6.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,250 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/azure-storage-2.2.0.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/oozie/azure-storage-2.2.0.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,251 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/commons-lang3-3.3.2.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/oozie/commons-lang3-3.3.2.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,252 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/guava-11.0.2.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/oozie/guava-11.0.2.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,252 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/hadoop-aws-2.7.3.2.5.0.0-1245.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/oozie/hadoop-aws-2.7.3.2.5.0.0-1245.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,253 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/hadoop-azure-2.7.3.2.5.0.0-1245.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/oozie/hadoop-azure-2.7.3.2.5.0.0-1245.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,253 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/jackson-annotations-2.4.0.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/oozie/jackson-annotations-2.4.0.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,254 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/jackson-core-2.4.4.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/oozie/jackson-core-2.4.4.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,255 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/jackson-databind-2.4.4.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/oozie/jackson-databind-2.4.4.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,255 WARN [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.util.MRApps: cache file (mapreduce.job.cache.files) hdfs://:8020/smartdata/oozie/lib/joda-time-2.1.jar conflicts with cache file (mapreduce.job.cache.files) hdfs://:8020/user/oozie/share/lib/lib_20160928171540/oozie/joda-time-2.1.jar This will be an error in Hadoop 2.0 2016-10-27 11:42:58,257 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1 tokens and #1 secret keys for NM use for launching container 2016-10-27 11:42:58,257 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 2 2016-10-27 11:42:58,257 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData 2016-10-27 11:42:58,379 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1477324998079_0488_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-10-27 11:42:58,382 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e23_1477324998079_0488_01_000002 taskAttempt attempt_1477324998079_0488_m_000000_0 2016-10-27 11:42:58,384 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1477324998079_0488_m_000000_0 2016-10-27 11:42:58,384 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : :45454 2016-10-27 11:42:58,431 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1477324998079_0488_m_000000_0 : 13562 2016-10-27 11:42:58,432 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1477324998079_0488_m_000000_0] using containerId: [container_e23_1477324998079_0488_01_000002 on NM: [:45454] 2016-10-27 11:42:58,434 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1477324998079_0488_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-10-27 11:42:58,435 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1477324998079_0488_m_000000 Task Transitioned from SCHEDULED to RUNNING 2016-10-27 11:42:59,193 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1477324998079_0488: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit= knownNMs=2 2016-10-27 11:42:59,711 INFO [Socket Reader #1 for port 34544] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1477324998079_0488 (auth:SIMPLE) 2016-10-27 11:42:59,728 INFO [IPC Server handler 0 on 34544] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1477324998079_0488_m_25288767438850 asked for a task 2016-10-27 11:42:59,729 INFO [IPC Server handler 0 on 34544] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1477324998079_0488_m_25288767438850 given task: attempt_1477324998079_0488_m_000000_0 2016-10-27 11:43:04,159 INFO [IPC Server handler 0 on 34544] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1477324998079_0488_m_000000_0 is : 0.0 2016-10-27 11:43:04,473 INFO [IPC Server handler 5 on 34544] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1477324998079_0488_m_000000_0 2016-10-27 11:43:04,474 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1477324998079_0488_m_000000_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING 2016-10-27 11:43:04,474 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1477324998079_0488_m_000000_0 given a go for committing the task output. 2016-10-27 11:43:04,475 INFO [IPC Server handler 4 on 34544] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1477324998079_0488_m_000000_0 2016-10-27 11:43:04,475 INFO [IPC Server handler 4 on 34544] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1477324998079_0488_m_000000_0:true 2016-10-27 11:43:04,623 INFO [IPC Server handler 2 on 34544] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1477324998079_0488_m_000000_0 is : 1.0 2016-10-27 11:43:04,628 INFO [IPC Server handler 1 on 34544] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1477324998079_0488_m_000000_0 2016-10-27 11:43:04,629 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1477324998079_0488_m_000000_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP 2016-10-27 11:43:04,630 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e23_1477324998079_0488_01_000002 taskAttempt attempt_1477324998079_0488_m_000000_0 2016-10-27 11:43:04,630 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1477324998079_0488_m_000000_0 2016-10-27 11:43:04,630 INFO [ContainerLauncher #1] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : :45454 2016-10-27 11:43:04,641 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1477324998079_0488_m_000000_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED 2016-10-27 11:43:04,647 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1477324998079_0488_m_000000_0 2016-10-27 11:43:04,648 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1477324998079_0488_m_000000 Task Transitioned from RUNNING to SUCCEEDED 2016-10-27 11:43:04,649 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1 2016-10-27 11:43:04,649 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1477324998079_0488Job Transitioned from RUNNING to COMMITTING 2016-10-27 11:43:04,650 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_COMMIT 2016-10-27 11:43:05,199 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:1 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0 2016-10-27 11:43:05,203 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_e23_1477324998079_0488_01_000002 2016-10-27 11:43:05,204 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0 2016-10-27 11:43:05,204 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1477324998079_0488_m_000000_0: Container killed by the ApplicationMaster. Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143 2016-10-27 11:43:05,231 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler for JobFinishedEvent 2016-10-27 11:43:05,232 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1477324998079_0488Job Transitioned from COMMITTING to SUCCEEDED 2016-10-27 11:43:05,232 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry 2016-10-27 11:43:05,232 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true 2016-10-27 11:43:05,232 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator notified that shouldUnregistered is: true 2016-10-27 11:43:05,232 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true 2016-10-27 11:43:05,232 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true 2016-10-27 11:43:05,233 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services 2016-10-27 11:43:05,233 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0 2016-10-27 11:43:05,446 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://:8020/user/apiminov/.staging/job_1477324998079_0488/job_1477324998079_0488_1.jhist to hdfs://:8020/mr-history/tmp/apiminov/job_1477324998079_0488-1477557772094-apiminov-oozie%3Alauncher%3AT%3Dsqoop%3AW%3Dgp_overcoll_wf%3AA%3Dsqoop%3AID-1477557785230-1-0-SUCCEEDED-default-1477557776109.jhist_tmp 2016-10-27 11:43:05,573 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://:8020/mr-history/tmp/apiminov/job_1477324998079_0488-1477557772094-apiminov-oozie%3Alauncher%3AT%3Dsqoop%3AW%3Dgp_overcoll_wf%3AA%3Dsqoop%3AID-1477557785230-1-0-SUCCEEDED-default-1477557776109.jhist_tmp 2016-10-27 11:43:05,607 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://:8020/user/apiminov/.staging/job_1477324998079_0488/job_1477324998079_0488_1_conf.xml to hdfs://:8020/mr-history/tmp/apiminov/job_1477324998079_0488_conf.xml_tmp 2016-10-27 11:43:05,733 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://:8020/mr-history/tmp/apiminov/job_1477324998079_0488_conf.xml_tmp 2016-10-27 11:43:05,807 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://:8020/mr-history/tmp/apiminov/job_1477324998079_0488.summary_tmp to hdfs://:8020/mr-history/tmp/apiminov/job_1477324998079_0488.summary 2016-10-27 11:43:05,841 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://:8020/mr-history/tmp/apiminov/job_1477324998079_0488_conf.xml_tmp to hdfs://:8020/mr-history/tmp/apiminov/job_1477324998079_0488_conf.xml 2016-10-27 11:43:05,909 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://:8020/mr-history/tmp/apiminov/job_1477324998079_0488-1477557772094-apiminov-oozie%3Alauncher%3AT%3Dsqoop%3AW%3Dgp_overcoll_wf%3AA%3Dsqoop%3AID-1477557785230-1-0-SUCCEEDED-default-1477557776109.jhist_tmp to hdfs://:8020/mr-history/tmp/apiminov/job_1477324998079_0488-1477557772094-apiminov-oozie%3Alauncher%3AT%3Dsqoop%3AW%3Dgp_overcoll_wf%3AA%3Dsqoop%3AID-1477557785230-1-0-SUCCEEDED-default-1477557776109.jhist 2016-10-27 11:43:05,910 INFO [Thread-68] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop() 2016-10-27 11:43:05,912 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job diagnostics to 2016-10-27 11:43:05,912 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: History url is http://:19888/jobhistory/job/job_1477324998079_0488 2016-10-27 11:43:05,917 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Waiting for application to be successfully unregistered. 2016-10-27 11:43:06,918 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:1 ContRel:0 HostLocal:0 RackLocal:0 2016-10-27 11:43:06,919 INFO [Thread-68] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://:8020 /user/apiminov/.staging/job_1477324998079_0488 2016-10-27 11:43:06,955 INFO [Thread-68] org.apache.hadoop.ipc.Server: Stopping server on 34544 2016-10-27 11:43:06,956 INFO [IPC Server listener on 34544] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 34544 2016-10-27 11:43:06,957 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder 2016-10-27 11:43:06,957 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted