Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

[YARN] SQOOP application KILLED

Highlighted

[YARN] SQOOP application KILLED

New Contributor

Hi all,

I'm try running a sqoop job and fall to killed job but i don't know why ?

Here application log :

2017-08-21 14:21:15,179 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #4 tokens and #1 secret keys for NM use for launching container
2017-08-21 14:21:15,179 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 5
2017-08-21 14:21:15,179 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData
2017-08-21 14:21:15,563 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1501688338199_102303_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2017-08-21 14:21:15,567 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_e71_1501688338199_102303_01_000002 taskAttempt attempt_1501688338199_102303_m_000000_0
2017-08-21 14:21:15,568 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1501688338199_102303_m_000000_0
2017-08-21 14:21:15,569 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : host049:45454
2017-08-21 14:21:15,629 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1501688338199_102303_m_000000_0 : 13562
2017-08-21 14:21:15,630 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1501688338199_102303_m_000000_0] using containerId: [container_e71_1501688338199_102303_01_000002 on NM: [host049:45454]
2017-08-21 14:21:15,634 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1501688338199_102303_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
2017-08-21 14:21:15,634 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1501688338199_102303_m_000000 Task Transitioned from SCHEDULED to RUNNING
2017-08-21 14:21:15,981 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1501688338199_102303: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:239616, vCores:77> knownNMs=57
2017-08-21 14:21:16,767 INFO [Socket Reader #1 for port 44108] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for user001 (auth:SIMPLE)
2017-08-21 14:21:16,774 INFO [Socket Reader #1 for port 44108] SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for user001 (auth:TOKEN) for protocol=interface org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB
2017-08-21 14:21:16,826 INFO [IPC Server handler 0 on 44108] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Kill job job_1501688338199_102303 received from user001 (auth:TOKEN) at 10.99.224.106
2017-08-21 14:21:16,828 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1501688338199_102303Job Transitioned from RUNNING to KILL_WAIT
2017-08-21 14:21:16,842 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1501688338199_102303_m_000000 Task Transitioned from RUNNING to KILL_WAIT
2017-08-21 14:21:16,850 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1501688338199_102303_m_000000_0 TaskAttempt Transitioned from RUNNING to KILL_CONTAINER_CLEANUP
2017-08-21 14:21:16,850 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e71_1501688338199_102303_01_000002 taskAttempt attempt_1501688338199_102303_m_000000_0
2017-08-21 14:21:16,851 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1501688338199_102303_m_000000_0
2017-08-21 14:21:16,851 INFO [ContainerLauncher #1] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : host049:45454
2017-08-21 14:21:16,866 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1501688338199_102303_m_000000_0 TaskAttempt Transitioned from KILL_CONTAINER_CLEANUP to KILL_TASK_CLEANUP
2017-08-21 14:21:16,867 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT
2017-08-21 14:21:16,873 WARN [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete hdfs://clusterbigdata/user/user001/oozie-oozi/0005541-170818100252684-oozie-oozi-W/sqoop-d8b5--sqoop/output/_temporary/1/_temporary/attempt_1501688338199_102303_m_000000_0
2017-08-21 14:21:16,879 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1501688338199_102303_m_000000_0 TaskAttempt Transitioned from KILL_TASK_CLEANUP to KILLED
2017-08-21 14:21:16,889 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1501688338199_102303_m_000000 Task Transitioned from KILL_WAIT to KILLED
2017-08-21 14:21:16,892 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1
2017-08-21 14:21:16,892 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1501688338199_102303Job Transitioned from KILL_WAIT to KILL_ABORT
2017-08-21 14:21:16,893 INFO [CommitterEvent Processor #2] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_ABORT
2017-08-21 14:21:16,904 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1501688338199_102303Job Transitioned from KILL_ABORT to KILLED
2017-08-21 14:21:16,904 INFO [Thread-67] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry
2017-08-21 14:21:16,905 INFO [Thread-67] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true

Thanks for helps.

Don't have an account?
Coming from Hortonworks? Activate your account here