Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

hive UDF java dependency hell

Highlighted

hive UDF java dependency hell

New Contributor

I face problems with a hive udf and java dependency hell:

    2018-02-19 10:11:49,328 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster
    java.lang.VerifyError: Bad return type
    Exception Details:
      Location:
        org/apache/hadoop/hdfs/DFSClient.getQuotaUsage(Ljava/lang/String;)Lorg/apache/hadoop/fs/QuotaUsage; @94: areturn
      Reason:
        Type 'org/apache/hadoop/fs/ContentSummary' (current frame, stack[0]) is not assignable to 'org/apache/hadoop/fs/QuotaUsage' (from method signature) 

Obviously, somehow dependencies are clashing with wrong versions. When looking at the jar via

jar tf myjar.jar | grep hdfs

no contents are returned. The same for

fd

This seems strange to me as the exception clearly states that these should be involved in the problem. The error occurs only on Tez, not on regular hive.

1 REPLY 1

Re: hive UDF java dependency hell

New Contributor

Hi, were you able to resolve this problem? I too am running onto the similar issue, Let me know if you resolved this one.

Don't have an account?
Coming from Hortonworks? Activate your account here