Support Questions

Find answers, ask questions, and share your expertise
Announcements
Welcome to the upgraded Community! Read this blog to see What’s New!

Add one more hive metastore but start failed

avatar
New Contributor

Hi

I used HDP-2.6.2.14 with Kerberos and tried to build up a hive Metastore HA by Ambari UI. Added one more hive Metastore was successful and the process could be started. But I found there was an error show in hivemetastore.log. Need someone give me some suggestions to tune its work properly, thanks.

2018-03-30 13:18:43,849 INFO  [Thread[Thread-14,5,main]]: thrift.TokenStoreDelegationTokenSecretManager (TokenStoreDelegationTokenSecretManager.java:logUpdateMasterKey(199)) - New master key with key id=39
2018-03-30 13:18:43,879 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6729)) - Starting DB backed MetaStore Server in Secure Mode
2018-03-30 13:18:43,881 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6793)) - Started the new metaserver on port [9083]...
2018-03-30 13:18:43,881 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6795)) - Options.minWorkerThreads = 200
2018-03-30 13:18:43,882 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6797)) - Options.maxWorkerThreads = 100000
2018-03-30 13:18:43,882 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6799)) - TCP keepalive = true
2018-03-30 13:21:05,175 ERROR [pool-7-thread-1]: server.TThreadPoolServer (TThreadPoolServer.java:run(297)) - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Invalid status -128
        at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:609)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:606)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:360)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1846)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:606)
        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:269)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: Invalid status -128
        at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
        at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184)
        at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
        at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
        at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
        at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
        ... 10 more
    <property>
      <name>hive.server2.authentication</name>
      <value>KERBEROS</value>
    </property>
    <property>
      <name>hive.server2.authentication.kerberos.keytab</name>
      <value>/etc/security/keytabs/hive.service.keytab</value>
    </property>
    <property>
      <name>hive.server2.authentication.kerberos.principal</name>
      <value>hive/_HOST@HADOOP.LAB.COM</value>
    </property>
    <property>
      <name>hive.server2.authentication.spnego.keytab</name>
      <value>/etc/security/keytabs/spnego.service.keytab</value>
    </property>
    <property>
      <name>hive.server2.authentication.spnego.principal</name>
      <value>HTTP/_HOST@HADOOP.LAB.COM</value>
    </property>
    <property>
      <name>hive.server2.enable.doAs</name>
      <value>true</value>
    </property>
1 ACCEPTED SOLUTION

avatar
New Contributor

Found the problem caused by missing some parameters from hiveconf.

Then, install Hive Client on the second Metastore host fixed that.

View solution in original post

1 REPLY 1

avatar
New Contributor

Found the problem caused by missing some parameters from hiveconf.

Then, install Hive Client on the second Metastore host fixed that.

Labels