Member since
07-21-2017
4
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
858 | 04-11-2018 05:26 AM |
04-11-2018
05:26 AM
Found the problem caused by missing some parameters from hiveconf. Then, install Hive Client on the second Metastore host fixed that.
... View more
03-30-2018
05:36 AM
Hi I used HDP-2.6.2.14 with Kerberos and tried to build up a hive Metastore HA by Ambari UI. Added one more hive Metastore was successful and the process could be started. But I found there was an error show in hivemetastore.log. Need someone give me some suggestions to tune its work properly, thanks. 2018-03-30 13:18:43,849 INFO [Thread[Thread-14,5,main]]: thrift.TokenStoreDelegationTokenSecretManager (TokenStoreDelegationTokenSecretManager.java:logUpdateMasterKey(199)) - New master key with key id=39
2018-03-30 13:18:43,879 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6729)) - Starting DB backed MetaStore Server in Secure Mode
2018-03-30 13:18:43,881 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6793)) - Started the new metaserver on port [9083]...
2018-03-30 13:18:43,881 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6795)) - Options.minWorkerThreads = 200
2018-03-30 13:18:43,882 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6797)) - Options.maxWorkerThreads = 100000
2018-03-30 13:18:43,882 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6799)) - TCP keepalive = true
2018-03-30 13:21:05,175 ERROR [pool-7-thread-1]: server.TThreadPoolServer (TThreadPoolServer.java:run(297)) - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Invalid status -128
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:609)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:606)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1846)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:606)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:269)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: Invalid status -128
at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184)
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
... 10 more <property>
<name>hive.server2.authentication</name>
<value>KERBEROS</value>
</property>
<property>
<name>hive.server2.authentication.kerberos.keytab</name>
<value>/etc/security/keytabs/hive.service.keytab</value>
</property>
<property>
<name>hive.server2.authentication.kerberos.principal</name>
<value>hive/_HOST@HADOOP.LAB.COM</value>
</property>
<property>
<name>hive.server2.authentication.spnego.keytab</name>
<value>/etc/security/keytabs/spnego.service.keytab</value>
</property>
<property>
<name>hive.server2.authentication.spnego.principal</name>
<value>HTTP/_HOST@HADOOP.LAB.COM</value>
</property>
<property>
<name>hive.server2.enable.doAs</name>
<value>true</value>
</property>
... View more
Labels:
- Labels:
-
Apache Hive
12-27-2017
12:48 AM
Thanks @ssharma. I'll try it.
... View more
12-26-2017
03:30 AM
Just thinking about adding more Metrics Collectors might speed up gathering cluster data. Is it a known procedure to set it up?
... View more