2016-12-01 16:24:08,314 [INFO] [main] |app.DAGAppMaster|: Creating DAGAppMaster for applicationId=application_1480605726606_0004, attemptNum=1, AMContainerId=container_e62_1480605726606_0004_01_000001, jvmPid=5225, userFromEnv=root, cliSessionOption=true, pwd=/hadoop/yarn/local/usercache/root/appcache/application_1480605726606_0004/container_e62_1480605726606_0004_01_000001, localDirs=/hadoop/yarn/local/usercache/root/appcache/application_1480605726606_0004, logDirs=/hadoop/yarn/log/application_1480605726606_0004/container_e62_1480605726606_0004_01_000001 2016-12-01 16:24:09,117 [INFO] [main] |app.DAGAppMaster|: Created DAGAppMaster for application appattempt_1480605726606_0004_000001, versionInfo=[ component=tez-dag, version=0.7.0.2.4.0.0-169, revision=3c1431f45faaca982ecc8dad13a107787b834696, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20160210-0711 ] 2016-12-01 16:24:09,159 [INFO] [main] |app.DAGAppMaster|: Comparing client version with AM version, clientVersion=0.7.0.2.4.0.0-169, AMVersion=0.7.0.2.4.0.0-169 2016-12-01 16:24:10,800 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap 2016-12-01 16:24:10,802 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeTracker 2016-12-01 16:24:10,804 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler 2016-12-01 16:24:10,804 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher 2016-12-01 16:24:10,804 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher 2016-12-01 16:24:10,804 [INFO] [main] |app.DAGAppMaster|: Using concurrent dispatcher: false 2016-12-01 16:24:10,805 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher 2016-12-01 16:24:10,806 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher 2016-12-01 16:24:10,807 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for independent dispatch using: class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler 2016-12-01 16:24:10,807 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.dag.event.SpeculatorEventType for class org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler 2016-12-01 16:24:10,829 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerEventHandler 2016-12-01 16:24:10,831 [INFO] [main] |common.AsyncDispatcher|: Registering class org.apache.tez.dag.app.rm.NMCommunicatorEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherImpl 2016-12-01 16:24:10,947 [INFO] [main] |node.AMNodeTracker|: blacklistDisablePercent is 33, blacklistingEnabled: true, maxTaskFailuresPerNode: 10 2016-12-01 16:24:10,949 [ERROR] [main] |web.WebUIService|: Tez UI History URL is not set 2016-12-01 16:24:10,953 [INFO] [main] |launcher.ContainerLauncherImpl|: Upper limit on the thread pool size is 500 2016-12-01 16:24:10,953 [INFO] [main] |history.HistoryEventHandler|: Initializing HistoryEventHandler withrecoveryEnabled=true, historyServiceClassName=org.apache.tez.dag.history.logging.ats.ATSV15HistoryLoggingService 2016-12-01 16:24:11,481 [INFO] [main] |impl.TimelineClientImpl|: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/ 2016-12-01 16:24:11,481 [INFO] [main] |ats.ATSV15HistoryLoggingService|: Initializing ATSV15HistoryLoggingService with , maxPollingTime(ms)=10, waitTimeForShutdown(ms)=-1, TimelineACLManagerClass=org.apache.tez.dag.history.ats.acls.ATSV15HistoryACLPolicyManager 2016-12-01 16:24:11,641 [INFO] [main] |impl.TimelineClientImpl|: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/ 2016-12-01 16:24:11,823 [INFO] [main] |recovery.RecoveryService|: RecoveryService initialized with recoveryPath=hdfs://sandbox.hortonworks.com:8020/tmp/hive/root/_tez_session_dir/526b16b1-1c31-4c79-8c50-4ab240368c21/.tez/application_1480605726606_0004/recovery/1, bufferSize(bytes)=8192, flushInterval(s)=30, maxUnflushedEvents=100 2016-12-01 16:24:11,824 [INFO] [main] |history.HistoryEventHandler|: [HISTORY][DAG:N/A][Event:APP_LAUNCHED]: applicationId=application_1480605726606_0004, appSubmitTime=1480609446692, launchTime=1480609449116 2016-12-01 16:24:11,825 [INFO] [main] |history.HistoryEventHandler|: [HISTORY][DAG:N/A][Event:AM_LAUNCHED]: appAttemptId=appattempt_1480605726606_0004_000001, appSubmitTime=1480609446692, launchTime=1480609449116 2016-12-01 16:24:11,882 [INFO] [ServiceThread:org.apache.tez.dag.app.launcher.ContainerLauncherImpl] |impl.ContainerManagementProtocolProxy|: yarn.client.max-cached-nodemanagers-proxies : 0 2016-12-01 16:24:11,931 [INFO] [ServiceThread:DAGClientRPCServer] |ipc.CallQueueManager|: Using callQueue class java.util.concurrent.LinkedBlockingQueue 2016-12-01 16:24:11,932 [INFO] [ServiceThread:org.apache.tez.dag.app.TaskAttemptListenerImpTezDag] |ipc.CallQueueManager|: Using callQueue class java.util.concurrent.LinkedBlockingQueue 2016-12-01 16:24:11,950 [INFO] [HistoryEventHandlingThread] |impl.TimelineClientImpl|: Writing summary log for appattempt_1480605726606_0004_000001 to /ats/active/application_1480605726606_0004/appattempt_1480605726606_0004_000001/summarylog-appattempt_1480605726606_0004_000001 2016-12-01 16:24:11,990 [INFO] [Socket Reader #1 for port 55533] |ipc.Server|: Starting Socket Reader #1 for port 55533 2016-12-01 16:24:11,992 [INFO] [Socket Reader #1 for port 33530] |ipc.Server|: Starting Socket Reader #1 for port 33530 2016-12-01 16:24:12,071 [INFO] [IPC Server Responder] |ipc.Server|: IPC Server Responder: starting 2016-12-01 16:24:12,071 [INFO] [IPC Server listener on 55533] |ipc.Server|: IPC Server listener on 55533: starting 2016-12-01 16:24:12,073 [INFO] [ServiceThread:DAGClientRPCServer] |client.DAGClientServer|: Instantiated DAGClientRPCServer at sandbox.hortonworks.com/10.0.2.15:55533 2016-12-01 16:24:12,084 [INFO] [IPC Server Responder] |ipc.Server|: IPC Server Responder: starting 2016-12-01 16:24:12,085 [INFO] [IPC Server listener on 33530] |ipc.Server|: IPC Server listener on 33530: starting 2016-12-01 16:24:12,113 [INFO] [ServiceThread:org.apache.tez.dag.app.TaskAttemptListenerImpTezDag] |app.TaskAttemptListenerImpTezDag|: Instantiated TaskAttemptListener RPC at sandbox.hortonworks.com/10.0.2.15:33530 2016-12-01 16:24:12,172 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |mortbay.log|: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2016-12-01 16:24:12,185 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |server.AuthenticationFilter|: Unable to initialize FileSignerSecretProvider, falling back to use random secrets. 2016-12-01 16:24:12,191 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |http.HttpRequestLog|: Http request log for http.requests. is not defined 2016-12-01 16:24:12,196 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |http.HttpServer2|: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 2016-12-01 16:24:12,202 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |http.HttpServer2|: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context 2016-12-01 16:24:12,202 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |http.HttpServer2|: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static 2016-12-01 16:24:12,206 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |http.HttpServer2|: adding path spec: /* 2016-12-01 16:24:12,232 [INFO] [HistoryEventHandlingThread] |impl.TimelineClientImpl|: Writing summary log for appattempt_1480605726606_0004_000001 to /ats/active/application_1480605726606_0004/appattempt_1480605726606_0004_000001/summarylog-appattempt_1480605726606_0004_000001 2016-12-01 16:24:12,748 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |webapp.WebApps|: Registered webapp guice modules 2016-12-01 16:24:12,749 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |http.HttpServer2|: Jetty bound to port 59196 2016-12-01 16:24:12,750 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |mortbay.log|: jetty-6.1.26.hwx 2016-12-01 16:24:12,785 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |mortbay.log|: Extract jar:file:/hadoop/yarn/local/filecache/10/tez.tar.gz/lib/hadoop-yarn-common-2.7.1.2.4.0.0-169.jar!/webapps/ to /hadoop/yarn/local/usercache/root/appcache/application_1480605726606_0004/container_e62_1480605726606_0004_01_000001/tmp/Jetty_0_0_0_0_59196_webapps____ku95aj/webapp 2016-12-01 16:24:13,007 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |mortbay.log|: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:59196 2016-12-01 16:24:13,008 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |webapp.WebApps|: Web app started at 59196 2016-12-01 16:24:13,008 [INFO] [ServiceThread:org.apache.tez.dag.app.web.WebUIService] |web.WebUIService|: Instantiated WebUIService at http://sandbox.hortonworks.com:59196/ui/ 2016-12-01 16:24:13,042 [INFO] [ServiceThread:org.apache.tez.dag.app.rm.TaskSchedulerEventHandler] |rm.YarnTaskSchedulerService|: YarnTaskScheduler initialized with configuration: maxRMHeartbeatInterval: 250, containerReuseEnabled: true, reuseRackLocal: true, reuseNonLocal: false, localitySchedulingDelay: 250, preemptionPercentage: 10, preemptionMaxWaitTime: 60000, numHeartbeatsBetweenPreemptions: 3, idleContainerMinTimeout: 10000, idleContainerMaxTimeout: 20000, sessionMinHeldContainers: 0 2016-12-01 16:24:13,072 [INFO] [ServiceThread:org.apache.tez.dag.app.rm.TaskSchedulerEventHandler] |client.RMProxy|: Connecting to ResourceManager at sandbox.hortonworks.com/10.0.2.15:8030 2016-12-01 16:24:13,177 [INFO] [main] |history.HistoryEventHandler|: [HISTORY][DAG:N/A][Event:AM_STARTED]: appAttemptId=appattempt_1480605726606_0004_000001, startTime=1480609453171 2016-12-01 16:24:13,177 [INFO] [main] |app.DAGAppMaster|: In Session mode. Waiting for DAG over RPC 2016-12-01 16:24:13,180 [INFO] [HistoryEventHandlingThread] |impl.TimelineClientImpl|: Writing summary log for appattempt_1480605726606_0004_000001 to /ats/active/application_1480605726606_0004/appattempt_1480605726606_0004_000001/summarylog-appattempt_1480605726606_0004_000001 2016-12-01 16:24:13,214 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: App total resource memory: 2000 cpu: 1 taskAllocations: 0 2016-12-01 16:24:13,215 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 1 lastPreemptionHeartbeat: 0 2016-12-01 16:24:13,216 [INFO] [Dispatcher thread {Central}] |node.AMNodeTracker|: Num cluster nodes = 1 2016-12-01 16:24:25,815 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 51 lastPreemptionHeartbeat: 50 2016-12-01 16:24:38,415 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 101 lastPreemptionHeartbeat: 100 2016-12-01 16:24:51,022 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 151 lastPreemptionHeartbeat: 150 2016-12-01 16:25:03,629 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 201 lastPreemptionHeartbeat: 200 2016-12-01 16:25:16,228 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 251 lastPreemptionHeartbeat: 250 2016-12-01 16:25:28,831 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 301 lastPreemptionHeartbeat: 300 2016-12-01 16:25:41,429 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 351 lastPreemptionHeartbeat: 350 2016-12-01 16:25:54,037 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 401 lastPreemptionHeartbeat: 400 2016-12-01 16:26:06,648 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 451 lastPreemptionHeartbeat: 450 2016-12-01 16:26:19,250 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 501 lastPreemptionHeartbeat: 500 2016-12-01 16:26:31,844 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 551 lastPreemptionHeartbeat: 550 2016-12-01 16:26:44,445 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 601 lastPreemptionHeartbeat: 600 2016-12-01 16:26:57,049 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 651 lastPreemptionHeartbeat: 650 2016-12-01 16:27:09,653 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 701 lastPreemptionHeartbeat: 700 2016-12-01 16:27:22,253 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 751 lastPreemptionHeartbeat: 750 2016-12-01 16:27:34,851 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 801 lastPreemptionHeartbeat: 800 2016-12-01 16:27:47,454 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 851 lastPreemptionHeartbeat: 850 2016-12-01 16:28:00,059 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 901 lastPreemptionHeartbeat: 900 2016-12-01 16:28:12,661 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 951 lastPreemptionHeartbeat: 950 2016-12-01 16:28:25,261 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 1001 lastPreemptionHeartbeat: 1000 2016-12-01 16:28:37,944 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 1051 lastPreemptionHeartbeat: 1050 2016-12-01 16:28:50,543 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 1101 lastPreemptionHeartbeat: 1100 2016-12-01 16:29:03,139 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 1151 lastPreemptionHeartbeat: 1150 2016-12-01 16:29:13,177 [INFO] [Timer-1] |app.DAGAppMaster|: Session timed out, lastDAGCompletionTime=1480609453177 ms, sessionTimeoutInterval=300000 ms 2016-12-01 16:29:13,178 [INFO] [Timer-1] |rm.TaskSchedulerEventHandler|: TaskScheduler notified that it should unregister from RM 2016-12-01 16:29:13,178 [INFO] [Timer-1] |app.DAGAppMaster|: No current running DAG, shutting down the AM 2016-12-01 16:29:13,178 [INFO] [Timer-1] |app.DAGAppMaster|: DAGAppMasterShutdownHandler invoked 2016-12-01 16:29:13,178 [INFO] [Timer-1] |app.DAGAppMaster|: Handling DAGAppMaster shutdown 2016-12-01 16:29:13,179 [INFO] [AMShutdownThread] |app.DAGAppMaster|: Sleeping for 5 seconds before shutting down 2016-12-01 16:29:15,745 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: Free: pendingRequests: 0 delayedContainers: 0 heartbeats: 1201 lastPreemptionHeartbeat: 1200 2016-12-01 16:29:18,179 [INFO] [AMShutdownThread] |app.DAGAppMaster|: Calling stop for all the services 2016-12-01 16:29:18,179 [INFO] [AMShutdownThread] |rm.YarnTaskSchedulerService|: Initiating stop of YarnTaskScheduler 2016-12-01 16:29:18,179 [INFO] [AMShutdownThread] |rm.YarnTaskSchedulerService|: Releasing held containers 2016-12-01 16:29:18,180 [INFO] [AMShutdownThread] |rm.YarnTaskSchedulerService|: Removing all pending taskRequests 2016-12-01 16:29:18,181 [INFO] [AMShutdownThread] |history.HistoryEventHandler|: Stopping HistoryEventHandler 2016-12-01 16:29:18,181 [INFO] [AMShutdownThread] |recovery.RecoveryService|: Stopping RecoveryService 2016-12-01 16:29:18,181 [INFO] [AMShutdownThread] |recovery.RecoveryService|: Handle the remaining events in queue, queue size=0 2016-12-01 16:29:18,181 [INFO] [RecoveryEventHandlingThread] |recovery.RecoveryService|: EventQueue take interrupted. Returning 2016-12-01 16:29:18,182 [INFO] [AMShutdownThread] |ats.ATSV15HistoryLoggingService|: Stopping ATSService, eventQueueBacklog=0 2016-12-01 16:29:18,196 [INFO] [DelayedContainerManager] |rm.YarnTaskSchedulerService|: AllocatedContainerManager Thread interrupted 2016-12-01 16:29:18,201 [INFO] [AMShutdownThread] |rm.YarnTaskSchedulerService|: Unregistering application from RM, exitStatus=SUCCEEDED, exitMessage=Session stats:submittedDAGs=0, successfulDAGs=0, failedDAGs=0, killedDAGs=0 , trackingURL= 2016-12-01 16:29:18,209 [INFO] [AMShutdownThread] |impl.AMRMClientImpl|: Waiting for application to be successfully unregistered. 2016-12-01 16:29:18,311 [INFO] [AMShutdownThread] |rm.YarnTaskSchedulerService|: Successfully unregistered application from RM 2016-12-01 16:29:18,313 [INFO] [AMRM Callback Handler Thread] |impl.AMRMClientAsyncImpl|: Interrupted while waiting for queue java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl$CallbackHandlerThread.run(AMRMClientAsyncImpl.java:287) 2016-12-01 16:29:18,327 [INFO] [AMShutdownThread] |mortbay.log|: Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:0 2016-12-01 16:29:18,433 [INFO] [AMShutdownThread] |ipc.Server|: Stopping server on 33530 2016-12-01 16:29:18,437 [INFO] [IPC Server listener on 33530] |ipc.Server|: Stopping IPC Server listener on 33530 2016-12-01 16:29:18,438 [INFO] [AMShutdownThread] |ipc.Server|: Stopping server on 55533 2016-12-01 16:29:18,440 [INFO] [IPC Server Responder] |ipc.Server|: Stopping IPC Server Responder 2016-12-01 16:29:18,440 [INFO] [IPC Server listener on 55533] |ipc.Server|: Stopping IPC Server listener on 55533 2016-12-01 16:29:18,441 [INFO] [IPC Server Responder] |ipc.Server|: Stopping IPC Server Responder 2016-12-01 16:29:18,444 [INFO] [Thread-3] |app.DAGAppMaster|: DAGAppMasterShutdownHook invoked 2016-12-01 16:29:18,444 [INFO] [Thread-3] |app.DAGAppMaster|: The shutdown handler is still running, waiting for it to complete 2016-12-01 16:29:18,448 [WARN] [AMShutdownThread] |app.DAGAppMaster|: Failed to delete tez scratch data dir, path=hdfs://sandbox.hortonworks.com:8020/tmp/hive/root/_tez_session_dir/526b16b1-1c31-4c79-8c50-4ab240368c21/.tez/application_1480605726606_0004 2016-12-01 16:29:18,448 [INFO] [AMShutdownThread] |app.DAGAppMaster|: Exiting DAGAppMaster..GoodBye! 2016-12-01 16:29:18,448 [INFO] [Thread-3] |app.DAGAppMaster|: The shutdown handler has completed