Tez issue on hive

[#1]

hive> set hive.execution.engine=tez;

hive> select count(*) from page_view;

Query ID = hive_20170104114317_2a7bd7d5-e1a9-4984-82ba-af3fd4a89967

Total jobs = 1 Launching Job 1 out of 1 FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

[#2]

@Kuldeep Kulkarni

[#3]

@chennuri gouri shankar

Please launch hive shell in DEBUG mode with below command and try to run same query and post logs in here.

hive --hiveconf hive.root.logger=DEBUG,console

[#4]

I got following error message

2017-01-04T15:23:09,819 ERROR [main] exec.TaskRunner: Error in executeTask java.lang.NoClassDefFoundError: org/apache/tez/serviceplugins/api/TaskScheduler at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:763) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:467) at java.net.URLClassLoader.access$100(URLClassLoader.java:73) at java.net.URLClassLoader$1.run(URLClassLoader.java:368) at java.net.URLClassLoader$1.run(URLClassLoader.java:362) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:361) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.<clinit>(TezSessionState.java:102) at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.createAndInitSession(TezSessionPoolManager.java:258) at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getNewSessionState(TezSessionPoolManager.java:311) at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:291) at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:459) at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:396) at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:134) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:197) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2073) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1744) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1453) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1171) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1161) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:232) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:183) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:399) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:776) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:714) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:641) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: java.lang.ClassNotFoundException: org.apache.tez.serviceplugins.api.TaskScheduler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 38 more

[#5 · Accepted solution]

@chennuri gouri shankar

It looks like you have wrong version of tez.tar.gz on HDFS. Can you please verify that? If possible, please try to replace the same with latest version of tez.tar.gz.

Sometimes this kind of issue happens after an upgrade if older TEZ library exists on HDFS.