Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hive Metastore NullPointerException get_partitions_by_expr

Solved Go to solution
Highlighted

Hive Metastore NullPointerException get_partitions_by_expr

Guru

Hello,

in an upgraded HDP cluster (upgrade to 2.3.4) the following ERROR is shown in Metastore log:

2016-06-29 08:32:40,184 ERROR [pool-5-thread-109]: metastore.RetryingHMSHandler (RetryingHMSHandler.java:invoke(155)) -
MetaException(message:java.lang.NullPointerException)
        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newMetaException(HiveMetaStore.java:5420)
        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.rethrowException(HiveMetaStore.java:4542)
        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_partitions_by_expr(HiveMetaStore.java:4525)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
        at com.sun.proxy.$Proxy3.get_partitions_by_expr(Unknown Source)
        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_partitions_by_expr.getResult(ThriftHiv
eMetastore.java:10218)
        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_partitions_by_expr.getResult(ThriftHiv
eMetastore.java:10202)
        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridg
e.java:681)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridg
e.java:676)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBri
dge.java:676)
        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
        at org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.getExprString(ExprNodeGenericFuncDesc.java:158)
        at org.apache.hadoop.hive.ql.optimizer.ppr.PartitionExpressionForMetastore.convertExprToFilter(PartitionExpressi
onForMetastore.java:40)
        at org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsByExprInternal(ObjectStore.java:2072)
        at org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsByExpr(ObjectStore.java:2059)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:114)
        at com.sun.proxy.$Proxy0.getPartitionsByExpr(Unknown Source)
        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_partitions_by_expr(HiveMetaStore.java:4520)
        ... 20 more

Any hint where to investigate ?

Many thanks

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Hive Metastore NullPointerException get_partitions_by_expr

New Contributor

Hi @Gerd Koenig

This is a bug in hive libraries of version 1.2.1.2.3.0.0 . Upgrade to 1.2.1.2.3.4.7-4 and it will work.

View solution in original post

5 REPLIES 5
Highlighted

Re: Hive Metastore NullPointerException get_partitions_by_expr

Highlighted

Re: Hive Metastore NullPointerException get_partitions_by_expr

Guru

Hi @Jitendra Yadav , thanks for your reply.

Those issues are resolved and closed, and the Hive version which is in HDP 2.3.4 (Hive 1.2.1.2.3) should contain those fixes.

Any further hints how to investigate into this ?!?!

Highlighted

Re: Hive Metastore NullPointerException get_partitions_by_expr

Guru

...and in addition, the linked issues are not corresponding to the get_partitions_by_expr function.

Highlighted

Re: Hive Metastore NullPointerException get_partitions_by_expr

New Contributor

Hi @Gerd Koenig

This is a bug in hive libraries of version 1.2.1.2.3.0.0 . Upgrade to 1.2.1.2.3.4.7-4 and it will work.

View solution in original post

Highlighted

Re: Hive Metastore NullPointerException get_partitions_by_expr

Guru

Hi @Pavel Razumtsev ,

thanks for the update.

Don't have an account?
Coming from Hortonworks? Activate your account here