class not found exception while running UDF in impala

Yeseswini — Fri, 16 Sep 2022 12:52:40 GMT

Hi,

I am running UDF which has sql query .UDF is running fine in Hive.While running in Impala I am getting the below exception.

Prettytable cannot resolve string columns values that have embedded tabs. Reverting to tab delimited text output
++++java.lang.ClassNotFoundException: org.apache.hive.jdbc.HiveDriver
   at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
   at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
   at java.security.AccessController.doPrivileged(Native Method)
   at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
   at java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:789)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
   at java.lang.Class.forName0(Native Method)
   at java.lang.Class.forName(Class.java:190)
   at GetData.evaluate(GetData.java:53)
   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   at java.lang.reflect.Method.invoke(Method.java:606)
   at org.apache.impala.hive.executor.UdfExecutor.evaluate(UdfExecutor.java:353)
   at org.apache.impala.hive.executor.UdfExecutor.evaluate(UdfExecutor.java:288)
   at org.apache.impala.service.FeSupport.NativeEvalExprsWithoutRow(Native Method)
   at org.apache.impala.service.FeSupport.EvalExprsWithoutRow(FeSupport.java:172)
   at org.apache.impala.service.FeSupport.EvalExprWithoutRow(FeSupport.java:130)
   at org.apache.impala.analysis.LiteralExpr.create(LiteralExpr.java:178)
   at org.apache.impala.rewrite.FoldConstantsRule.apply(FoldConstantsRule.java:68)
   at org.apache.impala.rewrite.ExprRewriter.applyRuleBottomUp(ExprRewriter.java:85)
   at org.apache.impala.rewrite.ExprRewriter.applyRuleRepeatedly(ExprRewriter.java:71)
   at org.apache.impala.rewrite.ExprRewriter.rewrite(ExprRewriter.java:55)
   at org.apache.impala.analysis.SelectList.rewriteExprs(SelectList.java:97)
   at org.apache.impala.analysis.SelectStmt.rewriteExprs(SelectStmt.java:886)
   at org.apache.impala.analysis.AnalysisContext.analyze(AnalysisContext.java:396)
   at org.apache.impala.analysis.AnalysisContext.analyze(AnalysisContext.java:368)
   at org.apache.impala.service.Frontend.analyzeStmt(Frontend.java:903)
   at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1052)
   at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:156)

I changed driver to impala driver and tested but still same error with class not found exception on impala driver is coming.

Request your inputs or suggestions.

Thank You

Re: class not found exception while running UDF in impala

Tim Armstrong — Tue, 20 Feb 2018 00:51:19 GMT

It looks like it's referencing a Java class "org.apache.hive.jdbc.HiveDriver" that's not available on the Impala JVM's classpath. In Hive I assume that that class is deliberately or accidentally on the classpath of the java tasks spawned for the Hive job. Impala doesn't have that class on it's classpath.

It seems pretty weird for a UDF to depend on a use a database driver, so my first thought is to modify the UDF to removed the need for the dependency. Otherwise, generally, if you want to use Java classes from your UDF they would need to be built into the UDF JAR.

Re: class not found exception while running UDF in impala

Yeseswini — Thu, 22 Feb 2018 09:19:08 GMT

Thank You.It worked.

question Re: class not found exception while running UDF in impala in Support Questions

class not found exception while running UDF in impala

Re: class not found exception while running UDF in impala

Re: class not found exception while running UDF in impala