Support Questions

Find answers, ask questions, and share your expertise

Vertex failed error while executing hive query with 'where' clause

New Contributor

My Query - select action, dirtype from gti.test_threat_18 where dirtype = 'outbound'

Error Message -

INFO  : Session is already open
INFO  : Dag name: select action, dirtype from gti.test...10000(Stage-1)
INFO  : Tez session was closed. Reopening...
INFO  : Session re-established.
INFO  : 

INFO  : Status: Running (Executing on YARN cluster with App id application_1508346468136_0028)

INFO  : Map 1: -/-	
INFO  : Map 1: 0/142	
INFO  : Map 1: 0(+0,-3)/142	
INFO  : Map 1: 0(+2,-3)/142	
INFO  : Map 1: 0(+2,-5)/142	
INFO  : Map 1: 0(+4,-5)/142	
INFO  : Map 1: 0(+10,-5)/142	
INFO  : Map 1: 0(+11,-8)/142	
INFO  : Map 1: 0(+12,-10)/142	
INFO  : Map 1: 0(+14,-10)/142	
INFO  : Map 1: 0(+14,-12)/142	
INFO  : Map 1: 0(+14,-14)/142	
INFO  : Map 1: 0(+14,-16)/142	
INFO  : Map 1: 2(+12,-16)/142	
INFO  : Map 1: 2(+0,-18)/142	
ERROR : Status: Failed
ERROR : Vertex failed, vertexName=Map 1, vertexId=vertex_1508346468136_0028_1_00, diagnostics=[Task failed, taskId=task_1508346468136_0028_1_00_000008, diagnostics=[TaskAttempt 0 failed, info=[Container container_e48_1508346468136_0028_01_000017 finished with diagnostics set to [Container failed, exitCode=1. Exception from container-launch.
Container id: container_e48_1508346468136_0028_01_000017
Exit code: 1
Stack trace: ExitCodeException exitCode=1: 
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:576)
	at org.apache.hadoop.util.Shell.run(Shell.java:487)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:753)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:303)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
]], TaskAttempt 1 failed, info=[Container container_e48_1508346468136_0028_01_000023 finished with diagnostics set to [Container failed, exitCode=1. Exception from container-launch.
Container id: container_e48_1508346468136_0028_01_000023
Exit code: 1
Stack trace: ExitCodeException exitCode=1: 
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:576)
	at org.apache.hadoop.util.Shell.run(Shell.java:487)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:753)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:303)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
]], TaskAttempt 2 failed, info=[Container container_e48_1508346468136_0028_01_000027 finished with diagnostics set to [Container failed, exitCode=1. Exception from container-launch.
Container id: container_e48_1508346468136_0028_01_000027
Exit code: 1
Stack trace: ExitCodeException exitCode=1: 
	at org.apache.hadoop.util.Shell.runCommand(Shell.java:576)
	at org.apache.hadoop.util.Shell.run(Shell.java:487)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:753)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:303)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
2 REPLIES 2

Rising Star

Can you share the full application id log?

yarn logs -applicationId application_1508346468136_0028

New Contributor

I have attached a zip file instead of text file because of file size limitations.

The log file is for application_1508353627382_0279(same query was executed at different times).

Thanks in advance..!!