Support Questions
Find answers, ask questions, and share your expertise

Tez query failing with custom UDF's

Tez query failing with custom UDF's

New Contributor

Query : 

insert overwrite table test.bs_test select tid, test.rowid(tid) from (select distinct tid from (select tid1 as tid from test.tmp_input_test union all select tid2 as tid from test.tmp_input_test) a) b;

 

Error : 

ERROR : Vertex failed, vertexName=Map 5, vertexId=vertex_1578712809777_18727_2_00, diagnostics=[Task failed, taskId=task_1578712809777_18727_2_00_000007, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:org.apache.tez.dag.api.TezReflectionException: Unable to instantiate class with 1 arguments: org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor

at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:71)

at org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:89)

at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.createProcessor(LogicalIOProcessorRuntimeTask.java:639)

at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:212)

at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:191)

at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:185)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:422)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869)

at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:185)

at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:181)

at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

at java.lang.Thread.run(Thread.java:748)

Caused by: java.lang.NoSuchMethodException: org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor.<init>(org.apache.tez.runtime.api.ProcessorContext)

at java.lang.Class.getConstructor0(Class.java:3082)

at java.lang.Class.getConstructor(Class.java:1825)

at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:67)