Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Add one more hive metastore but start failed

Solved Go to solution

Add one more hive metastore but start failed

New Contributor

Hi

I used HDP-2.6.2.14 with Kerberos and tried to build up a hive Metastore HA by Ambari UI. Added one more hive Metastore was successful and the process could be started. But I found there was an error show in hivemetastore.log. Need someone give me some suggestions to tune its work properly, thanks.

2018-03-30 13:18:43,849 INFO  [Thread[Thread-14,5,main]]: thrift.TokenStoreDelegationTokenSecretManager (TokenStoreDelegationTokenSecretManager.java:logUpdateMasterKey(199)) - New master key with key id=39
2018-03-30 13:18:43,879 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6729)) - Starting DB backed MetaStore Server in Secure Mode
2018-03-30 13:18:43,881 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6793)) - Started the new metaserver on port [9083]...
2018-03-30 13:18:43,881 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6795)) - Options.minWorkerThreads = 200
2018-03-30 13:18:43,882 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6797)) - Options.maxWorkerThreads = 100000
2018-03-30 13:18:43,882 INFO  [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6799)) - TCP keepalive = true
2018-03-30 13:21:05,175 ERROR [pool-7-thread-1]: server.TThreadPoolServer (TThreadPoolServer.java:run(297)) - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Invalid status -128
        at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:609)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:606)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:360)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1846)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:606)
        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:269)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: Invalid status -128
        at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
        at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184)
        at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
        at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
        at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
        at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
        ... 10 more
    <property>
      <name>hive.server2.authentication</name>
      <value>KERBEROS</value>
    </property>
    <property>
      <name>hive.server2.authentication.kerberos.keytab</name>
      <value>/etc/security/keytabs/hive.service.keytab</value>
    </property>
    <property>
      <name>hive.server2.authentication.kerberos.principal</name>
      <value>hive/_HOST@HADOOP.LAB.COM</value>
    </property>
    <property>
      <name>hive.server2.authentication.spnego.keytab</name>
      <value>/etc/security/keytabs/spnego.service.keytab</value>
    </property>
    <property>
      <name>hive.server2.authentication.spnego.principal</name>
      <value>HTTP/_HOST@HADOOP.LAB.COM</value>
    </property>
    <property>
      <name>hive.server2.enable.doAs</name>
      <value>true</value>
    </property>
1 ACCEPTED SOLUTION

Accepted Solutions

Re: Add one more hive metastore but start failed

New Contributor

Found the problem caused by missing some parameters from hiveconf.

Then, install Hive Client on the second Metastore host fixed that.

1 REPLY 1

Re: Add one more hive metastore but start failed

New Contributor

Found the problem caused by missing some parameters from hiveconf.

Then, install Hive Client on the second Metastore host fixed that.