Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 03-30-2018 05:36 AM
Hi
I used HDP-2.6.2.14 with Kerberos and tried to build up a hive Metastore HA by Ambari UI. Added one more hive Metastore was successful and the process could be started. But I found there was an error show in hivemetastore.log. Need someone give me some suggestions to tune its work properly, thanks.
2018-03-30 13:18:43,849 INFO [Thread[Thread-14,5,main]]: thrift.TokenStoreDelegationTokenSecretManager (TokenStoreDelegationTokenSecretManager.java:logUpdateMasterKey(199)) - New master key with key id=39
2018-03-30 13:18:43,879 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6729)) - Starting DB backed MetaStore Server in Secure Mode
2018-03-30 13:18:43,881 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6793)) - Started the new metaserver on port [9083]...
2018-03-30 13:18:43,881 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6795)) - Options.minWorkerThreads = 200
2018-03-30 13:18:43,882 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6797)) - Options.maxWorkerThreads = 100000
2018-03-30 13:18:43,882 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:startMetaStore(6799)) - TCP keepalive = true
2018-03-30 13:21:05,175 ERROR [pool-7-thread-1]: server.TThreadPoolServer (TThreadPoolServer.java:run(297)) - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Invalid status -128
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:609)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:606)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1846)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:606)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:269)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: Invalid status -128
at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184)
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
... 10 more <property>
<name>hive.server2.authentication</name>
<value>KERBEROS</value>
</property>
<property>
<name>hive.server2.authentication.kerberos.keytab</name>
<value>/etc/security/keytabs/hive.service.keytab</value>
</property>
<property>
<name>hive.server2.authentication.kerberos.principal</name>
<value>hive/[email protected]</value>
</property>
<property>
<name>hive.server2.authentication.spnego.keytab</name>
<value>/etc/security/keytabs/spnego.service.keytab</value>
</property>
<property>
<name>hive.server2.authentication.spnego.principal</name>
<value>HTTP/[email protected]</value>
</property>
<property>
<name>hive.server2.enable.doAs</name>
<value>true</value>
</property>
Created 04-11-2018 05:26 AM
Found the problem caused by missing some parameters from hiveconf.
Then, install Hive Client on the second Metastore host fixed that.
Created 04-11-2018 05:26 AM
Found the problem caused by missing some parameters from hiveconf.
Then, install Hive Client on the second Metastore host fixed that.