Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Add one more hive metastore but start failed

avatar
Explorer

Hi

I used HDP-2.6.2.14 with Kerberos and tried to build up a hive Metastore HA by Ambari UI. Added one more hive Metastore was successful and the process could be started. But I found there was an error show in hivemetastore.log. Need someone give me some suggestions to tune its work properly, thanks.

2018-03-30 13:18:43,849 INFO  [Thread[Thread-14,5,main]]: thrift.TokenStoreDelegationTokenSecretManager (TokenStoreDelegationTokenSecretManager.java:logUpdateMasterKey(199)) - New master key with key id=39
2018-03-30 13:18:43,879 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6729)) - Starting DB backed MetaStore Server in Secure Mode
2018-03-30 13:18:43,881 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6793)) - Started the new metaserver on port [9083]...
2018-03-30 13:18:43,881 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6795)) - Options.minWorkerThreads = 200
2018-03-30 13:18:43,882 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6797)) - Options.maxWorkerThreads = 100000
2018-03-30 13:18:43,882 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6799)) - TCP keepalive = true
2018-03-30 13:21:05,175 ERROR [pool-7-thread-1]: server.TThreadPoolServer (TThreadPoolServer.java:run(297)) - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Invalid status -128
        at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:609)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:606)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:360)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1846)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:606)
        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:269)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: Invalid status -128
        at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
        at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184)
        at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
        at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
        at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
        at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
        ... 10 more
    <property>
      <name>hive.server2.authentication</name>
      <value>KERBEROS</value>
    </property>
    <property>
      <name>hive.server2.authentication.kerberos.keytab</name>
      <value>/etc/security/keytabs/hive.service.keytab</value>
    </property>
    <property>
      <name>hive.server2.authentication.kerberos.principal</name>
      <value>hive/_HOST@HADOOP.LAB.COM</value>
    </property>
    <property>
      <name>hive.server2.authentication.spnego.keytab</name>
      <value>/etc/security/keytabs/spnego.service.keytab</value>
    </property>
    <property>
      <name>hive.server2.authentication.spnego.principal</name>
      <value>HTTP/_HOST@HADOOP.LAB.COM</value>
    </property>
    <property>
      <name>hive.server2.enable.doAs</name>
      <value>true</value>
    </property>
1 ACCEPTED SOLUTION

avatar
Explorer

Found the problem caused by missing some parameters from hiveconf.

Then, install Hive Client on the second Metastore host fixed that.

View solution in original post

1 REPLY 1

avatar
Explorer

Found the problem caused by missing some parameters from hiveconf.

Then, install Hive Client on the second Metastore host fixed that.