I face problems with a hive udf and java dependency hell:
2018-02-19 10:11:49,328 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster java.lang.VerifyError: Bad return type Exception Details: Location: org/apache/hadoop/hdfs/DFSClient.getQuotaUsage(Ljava/lang/String;)Lorg/apache/hadoop/fs/QuotaUsage; @94: areturn Reason: Type 'org/apache/hadoop/fs/ContentSummary' (current frame, stack) is not assignable to 'org/apache/hadoop/fs/QuotaUsage' (from method signature)
Obviously, somehow dependencies are clashing with wrong versions. When looking at the jar via
jar tf myjar.jar | grep hdfs
no contents are returned. The same for
This seems strange to me as the exception clearly states that these should be involved in the problem. The error occurs only on Tez, not on regular hive.