Tez issue on hive

chennuri_gouris — Wed, 04 Jan 2017 19:41:16 GMT

hive> set hive.execution.engine=tez;

hive> select count(*) from page_view;

Query ID = hive_20170104114317_2a7bd7d5-e1a9-4984-82ba-af3fd4a89967

Total jobs = 1 Launching Job 1 out of 1 FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

Re: Tez issue on hive

chennuri_gouris — Wed, 04 Jan 2017 23:13:23 GMT

@Kuldeep Kulkarni

Re: Tez issue on hive

KuldeepK — Wed, 04 Jan 2017 23:15:29 GMT

@chennuri gouri shankar

Please launch hive shell in DEBUG mode with below command and try to run same query and post logs in here.

hive --hiveconf hive.root.logger=DEBUG,console

Re: Tez issue on hive

chennuri_gouris — Wed, 04 Jan 2017 23:22:40 GMT

I got following error message

2017-01-04T15:23:09,819 ERROR [main] exec.TaskRunner: Error in executeTask java.lang.NoClassDefFoundError: org/apache/tez/serviceplugins/api/TaskScheduler at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:763) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:467) at java.net.URLClassLoader.access$100(URLClassLoader.java:73) at java.net.URLClassLoader$1.run(URLClassLoader.java:368) at java.net.URLClassLoader$1.run(URLClassLoader.java:362) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:361) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.<clinit>(TezSessionState.java:102) at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.createAndInitSession(TezSessionPoolManager.java:258) at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getNewSessionState(TezSessionPoolManager.java:311) at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:291) at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:459) at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:396) at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:134) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:197) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2073) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1744) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1453) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1171) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1161) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:232) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:183) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:399) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:776) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:714) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:641) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: java.lang.ClassNotFoundException: org.apache.tez.serviceplugins.api.TaskScheduler at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 38 more

Re: Tez issue on hive

KuldeepK — Fri, 20 Jan 2017 22:51:54 GMT

@chennuri gouri shankar

It looks like you have wrong version of tez.tar.gz on HDFS. Can you please verify that? If possible, please try to replace the same with latest version of tez.tar.gz.

Sometimes this kind of issue happens after an upgrade if older TEZ library exists on HDFS.

question Re: Tez issue on hive in Archives of Support Questions (Read Only)

Tez issue on hive

Re: Tez issue on hive

Re: Tez issue on hive

Re: Tez issue on hive

Re: Tez issue on hive