Member since
08-08-2013
339
Posts
132
Kudos Received
27
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
13438 | 01-18-2018 08:38 AM | |
1164 | 05-11-2017 06:50 PM | |
8162 | 04-28-2017 11:00 AM | |
2973 | 04-12-2017 01:36 AM | |
2436 | 02-14-2017 05:11 AM |
06-29-2016
11:48 AM
Hi @Jitendra Yadav , thanks for your reply. Those issues are resolved and closed, and the Hive version which is in HDP 2.3.4 (Hive 1.2.1.2.3) should contain those fixes. Any further hints how to investigate into this ?!?!
... View more
06-29-2016
10:41 AM
Hello, in an upgraded HDP cluster (upgrade to 2.3.4) the following ERROR is shown in Metastore log: 2016-06-29 08:32:40,184 ERROR [pool-5-thread-109]: metastore.RetryingHMSHandler (RetryingHMSHandler.java:invoke(155)) -
MetaException(message:java.lang.NullPointerException)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newMetaException(HiveMetaStore.java:5420)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.rethrowException(HiveMetaStore.java:4542)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_partitions_by_expr(HiveMetaStore.java:4525)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
at com.sun.proxy.$Proxy3.get_partitions_by_expr(Unknown Source)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_partitions_by_expr.getResult(ThriftHiv
eMetastore.java:10218)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_partitions_by_expr.getResult(ThriftHiv
eMetastore.java:10202)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridg
e.java:681)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridg
e.java:676)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBri
dge.java:676)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.getExprString(ExprNodeGenericFuncDesc.java:158)
at org.apache.hadoop.hive.ql.optimizer.ppr.PartitionExpressionForMetastore.convertExprToFilter(PartitionExpressi
onForMetastore.java:40)
at org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsByExprInternal(ObjectStore.java:2072)
at org.apache.hadoop.hive.metastore.ObjectStore.getPartitionsByExpr(ObjectStore.java:2059)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:114)
at com.sun.proxy.$Proxy0.getPartitionsByExpr(Unknown Source)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_partitions_by_expr(HiveMetaStore.java:4520)
... 20 more Any hint where to investigate ? Many thanks
... View more
Labels:
- Labels:
-
Apache Hive
06-17-2016
06:50 PM
Hi @Enis, thanks for this hint.
I'll use that in a way like echo "status 'detailed'" >hbase.command
echo "exit" >> hbase.command
hbase shell -n hbase.command
=> and then further process the output with bash builtins Thanks, Gerd
... View more
06-17-2016
06:47 PM
Many thanks for the xplanation @Josh Elser I'll use status 'detailed' + some grep'ing around as mentioned by @Enis
... View more
06-17-2016
01:35 PM
1 Kudo
Hi, I want to get the current active HBaseMaster from Zookeeper under znode /hbase-secure/master via zkCli.sh commandline call. The output is almost fine, but the nodename is somehow screwed up, so that I cannot use it for comparisons later on => #>/usr/hdp/current/zookeeper-client/bin/zkCli.sh -server 01876.something.corp,01874.something.corp,02878.something.corp get /hbase-secure/master
Connecting to 01876.something.corp,01874.something.corp,02878.something.corp
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
WATCHER::
WatchedEvent state:SaslAuthenticated type:None path:null
�master:16000��O�;��PBUF
'
2878.something.corp�}�����*�}
cZxid = 0x6a00019c8a
ctime = Fri Jun 17 14:59:21 CEST 2016
mZxid = 0x6a00019c8a
mtime = Fri Jun 17 14:59:21 CEST 2016
pZxid = 0x6a00019c8a
cversion = 0
dataVersion = 0
aclVersion = 0
ephemeralOwner = 0x1555727df0a001c
dataLength = 75
numChildren = 0 Any hint how to get the correct nodename of the current active HBase Master via commandline ?!?! Thanks, Gerd ============= HDP 2.3.4.7, HBase HA , kerberized
... View more
Labels:
- Labels:
-
Apache HBase
06-03-2016
02:01 PM
Hi @Jitendra Yadav , thanks for getting back to me. In the meantime the issue got solved recently through a support call..... It looks like the upgrade process ran into a timeout while talking to Zookeeper. To proceed with the upgrade, the solution was to do "Pause Upgrade", go to Ambari Dashboard, check state of Zookeeper (which was fine, all up and running), then click "Resume Upgrade". After that the problem was gone and upgrade procedure continued. Best regards, Gerd
... View more
06-03-2016
12:14 PM
Hi, after covering prereq. for a rolling upgrade of HDP 2.2.4 to 2.3.4 (using Ambari 2.2.1.1) and starting the procedure, the first component, Zookeeper, fails with below error ("##zookeeperserver1##" is just a placeholder for real server name): ...
2016-06-03 13:42:07,725 - Will retry 1 time(s), caught exception: Failed to establish zookeeper quorum. Sleeping for 2 sec(s)
2016-06-03 13:42:09,727 - call['echo 'create /id1facad4c_date410316 mydata' | /usr/hdp/current/zookeeper-server/bin/zkCli.sh -server ##zookeeperserver1##:2181'] {'logoutput': True, 'user': 'zookeeper', 'quiet': False}
Connecting to ##zookeeperserver1##:2181
Welcome to ZooKeeper!
JLine support is enabled
WATCHER::
WatchedEvent state:AuthFailed type:None path:null
[zk: ##zookeeperserver1##:2181(CONNECTING) 0] create /id1facad4c_date410316 mydata
WATCHER::
WatchedEvent state:Disconnected type:None path:null
Exception in thread "main" org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /id1facad4c_date410316
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:698)
at org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:591)
at org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:363)
at org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:323)
at org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:282)
2016-06-03 13:42:10,174 - call returned (1, 'Connecting to ##zookeeperserver1##:2181\nWelcome to ZooKeeper!\nJLine support is enabled\n\nWATCHER::\n\nWatchedEvent state:AuthFailed type:None path:null\n[zk: ##zookeeperserver1##:2181(CONNECTING) 0] create /id1facad4c_date410316 mydata\n\nWATCHER::\n\nWatchedEvent state:Disconnected type:None path:null\nException in thread "main" org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /id1facad4c_date410316\n\tat org.apache.zookeeper.KeeperException.create(KeeperException.java:99)\n\tat org.apache.zookeeper.KeeperException.create(KeeperException.java:51)\n\tat org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)\n\tat org.apache.zookeeper.ZooKeeperMain.processZKCmd(ZooKeeperMain.java:698)\n\tat org.apache.zookeeper.ZooKeeperMain.processCmd(ZooKeeperMain.java:591)\n\tat org.apache.zookeeper.ZooKeeperMain.executeLine(ZooKeeperMain.java:363)\n\tat org.apache.zookeeper.ZooKeeperMain.run(ZooKeeperMain.java:323)\n\tat org.apache.zookeeper.ZooKeeperMain.main(ZooKeeperMain.java:282)') What to do to be able to proceed with the upgrade ?!?! Thanks, Gerd
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)
05-27-2016
12:37 PM
brilliant article @vshukla. ...and some questions 😉 : You mention a 'manual install' as well, how would it look like? What if cluster is kerberized, what configs will change or need to be added ? Will the above also work on HDP 2.3.4 incl. Spark 1.5.2 ? because I am currently fighting getting Zeppelin to work in kerberized HDP 2.3.4... Thanks in advance, Gerd
... View more
04-24-2016
04:02 PM
Hi, just as a "cleanup" of this thread, at the end I didn't figure out what was the real error, but after re-installing Ranger (incl. dropping db 'ranger') now it works. Sorry, not really a solution, but I just need a working env. asap 😉 Regards...
... View more
04-23-2016
01:23 PM
Hi @hkropp , thanks for this hint. I cross-checked with another cluster (same HDP-, same Ambari version) where Ranger is working as expected. The above mentioned properties are missing in both. I checked this doc to verify which user settings belongs to whom (I have to admit, it is a bit confusing 😉 ). The properties in Ambari - Ranger - Config looks like Therefore the users and password are in place (this config looks the same in another cluster where Ranger-plugins are working). The only thing I noticed is, that in Ranger-Web-Admin the user 'amb_ranger_admin' was missing. I created that user as 'new user' in Ranger Web UI with the same password as in Ambari. Unfortunately that didn't solve the problem, restarting HDFS/Hive/HBase still results in the same error message ...kind of guess-less right now. Maybe I will drop service Ranger and re-install it, since the cluster is not yet in "real use" Any further hints..?!?!
... View more