Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

execution error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.teztask error on hive on tez

avatar
Contributor

i am using hive and tez.whenever i am performing insert query its returns following error: execution error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.teztask

9 REPLIES 9

avatar
@Rajesh AJ

Can you please share the complete stack strace ?

avatar
Contributor

@Santhosh B Gowda

MismatchedTokenException(5!=313) at org.antlr.runtime.BaseRecognizer.recoverFromMismatchedToken(BaseRecognizer.java:617) at org.antlr.runtime.BaseRecognizer.match(BaseRecognizer.java:115) at org.apache.hadoop.hive.ql.parse.HiveParser.tableRowFormatFieldIdentifier(HiveParser.java:34846) at org.apache.hadoop.hive.ql.parse.HiveParser.rowFormatDelimited(HiveParser.java:33756) at org.apache.hadoop.hive.ql.parse.HiveParser.tableRowFormat(HiveParser.java:34040) at org.apache.hadoop.hive.ql.parse.HiveParser.createTableStatement(HiveParser.java:5361) at org.apache.hadoop.hive.ql.parse.HiveParser.ddlStatement(HiveParser.java:2648) at org.apache.hadoop.hive.ql.parse.HiveParser.execStatement(HiveParser.java:1658) at org.apache.hadoop.hive.ql.parse.HiveParser.statement(HiveParser.java:1117) at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:202) at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:166) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:428)

avatar

this is good, but we need the complete exception trace to find the root cause i.e below errors complete logs

 error: execution error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.teztask

avatar
Contributor

hive log path is /var/log/hive/hiveserver2.log

my error log is in below link

http://pastie.org/private/fnmpqvqquf19tjjptmjjg

avatar
Contributor

                 ERROR [main]: exec.Task (TezTask.java:execute(212)) - Failed to execute tez graph.org.apache.tez.dag.api.TezException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1481976368061_0016 to YARN : Application application_1481976368061_0016 submitted by user root to unknown queue: agent    at org.apache.tez.client.TezClient.start(TezClient.java:413)    at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:196)    at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.closeAndOpen(TezSessionPoolManager.java:311)    at org.apache.hadoop.hive.ql.exec.tez.TezTask.submit(TezTask.java:453)    at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:180)    at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)    at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:89)    at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1720)    at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1477)    at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1254)    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1118)    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1108)    at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:216)    at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:168)    at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:379)    at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:739)    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:684)    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:624)    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)    at java.lang.reflect.Method.invoke(Method.java:606)    at org.apache.hadoop.util.RunJar.run(RunJar.java:221)    at org.apache.hadoop.util.RunJar.main(RunJar.java:136)Caused by: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1481976368061_0016 to YARN : Application application_1481976368061_0016 submitted by user root to unknown queue: agent    at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:271)    at org.apache.tez.client.TezYarnClient.submitApplication(TezYarnClient.java:72)    at org.apache.tez.client.TezClient.start(TezClient.java:408)    ... 23 more2016-12-17 14:02:51,678 INFO  [main]: hooks.ATSHook (ATSHook.java:<init>(90)) - Created ATS Hook2016-12-17 14:02:51,678 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=FailureHook.org.apache.hadoop.hive.ql.hooks.ATSHook from=org.apache.hadoop.hive.ql.Driver>2016-12-17 14:02:51,679 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=FailureHook.org.apache.hadoop.hive.ql.hooks.ATSHook start=1481983371678 end=1481983371679 duration=1 from=org.apache.hadoop.hive.ql.Driver>2016-12-17 14:02:51,679 ERROR [main]: ql.Driver (SessionState.java:printError(932)) - FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask2016-12-17 14:02:51,679 INFO  [main]: ql.Driver (Driver.java:execute(1621)) - Resetting the caller context to 2016-12-17 14:02:51,679 INFO  [ATS Logger 0]: hooks.ATSHook (ATSHook.java:createPostHookEvent(193)) - Received post-hook notification for :root_20161217140249_635f254a-e5f1-4a5a-9703-2a2bd9612d252016-12-17 14:02:51,679 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=Driver.execute start=1481983369588 end=1481983371679 duration=2091 from=org.apache.hadoop.hive.ql.Driver>2016-12-17 14:02:51,679 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>2016-12-17 14:02:51,685 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=releaseLocks start=1481983371679 end=1481983371685 duration=6 from=org.apache.hadoop.hive.ql.Driver>2016-12-17 14:02:51,693 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>2016-12-17 14:02:51,693 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=releaseLocks start=1481983371693 end=1481983371693 duration=0 from=org.apache.hadoop.hive.ql.Driver>
                

avatar
Contributor

@Santhosh B Gowda

hive> INSERT OVERWRITE TABLE default.DRIVERDATA_ES_JAN11 SELECT KEY, CLAIMNUMBER, POL_NBR, VEHICLE_NBR, EXP_NBR, NAME, COVERAGE, ADDRESS FROM default.DRIVERDATA_TMP1;

Query ID = root_20161216053225_fd9bffd2-f2ed-46ec-aa7f-a4095f4775b4 Total jobs = 1 Launching Job 1 out of 1 Tez session was closed. Reopening... FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

avatar
Contributor

10418-screenshot-from-2016-12-17-182529.png

this is log file of hive

avatar
Rising Star

Can you check for any errors in hive.log (/tmp/<user>/hive.log). If it launched the appmaster, then could you share the am logs?

avatar
Contributor
2016-12-19 04:43:41,466 ERROR [main]: exec.Task (TezTask.java:execute(212)) - Failed to execute tez graph.
org.apache.tez.dag.api.TezException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1481976368061_0017 to YARN : Application application_1481976368061_0017 submitted by user root to unknown queue: agent
    at org.apache.tez.client.TezClient.start(TezClient.java:413)
    at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:196)
    at org.apache.hadoop.hive.ql.exec.tez.TezTask.updateSession(TezTask.java:271)
    at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:151)
    at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
    at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:89)
    at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1720)
    at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1477)
    at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1254)
    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1118)
    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1108)
    at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:216)
    at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:168)
    at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:379)
    at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:739)
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:684)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:624)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1481976368061_0017 to YARN : Application application_1481976368061_0017 submitted by user root to unknown queue: agent
    at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:271)
    at org.apache.tez.client.TezYarnClient.submitApplication(TezYarnClient.java:72)
    at org.apache.tez.client.TezClient.start(TezClient.java:408)
    ... 22 more
2016-12-19 04:43:41,466 INFO  [main]: hooks.ATSHook (ATSHook.java:<init>(90)) - Created ATS Hook
2016-12-19 04:43:41,466 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=FailureHook.org.apache.hadoop.hive.ql.hooks.ATSHook from=org.apache.hadoop.hive.ql.Driver>
2016-12-19 04:43:41,470 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=FailureHook.org.apache.hadoop.hive.ql.hooks.ATSHook start=1482122621466 end=1482122621470 duration=4 from=org.apache.hadoop.hive.ql.Driver>
2016-12-19 04:43:41,471 ERROR [main]: ql.Driver (SessionState.java:printError(932)) - FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask
2016-12-19 04:43:41,471 INFO  [main]: ql.Driver (Driver.java:execute(1621)) - Resetting the caller context to 
2016-12-19 04:43:41,471 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=Driver.execute start=1482122620489 end=1482122621471 duration=982 from=org.apache.hadoop.hive.ql.Driver>
2016-12-19 04:43:41,471 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
2016-12-19 04:43:41,471 INFO  [ATS Logger 0]: hooks.ATSHook (ATSHook.java:createPostHookEvent(193)) - Received post-hook notification for :root_20161219044340_094281c1-c0f2-4cc9-83a5-962b067937f7
2016-12-19 04:43:41,488 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=releaseLocks start=1482122621471 end=1482122621488 duration=17 from=org.apache.hadoop.hive.ql.Driver>
2016-12-19 04:43:41,505 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
2016-12-19 04:43:41,505 INFO  [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=releaseLocks start=1482122621505 end=1482122621505 duration=0 from=org.apache.hadoop.hive.ql.Driver>