Created 02-20-2017 03:42 PM
Hello,
While trying to ingest Data to Hive using Nifi - PutHiveStreaming. I'm stranded on the error while trying to connect to Hive Metastore.
HDP 2.5.3 / HDF 2.1.1 both kerberized
both technoted
https://community.hortonworks.com/articles/52856/stream-data-into-hive-like-a-king-using-nifi.html
and
have been applied to luck (While is wonder if the last one is still accurate with HDF2.1.1, however the error is present no matter with NAR file I use)
Extract of hivemetastore.log
2017-02-20 16:32:20,536 ERROR [pool-7-thread-195]: server.TThreadPoolServer (TThreadPoolServer.java:run(297)) - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Invalid status -128
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:609)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:606)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:606)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:269)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: Invalid status -128
at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184)
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
... 10 more
Browsing the knowledge base of Google did not help, Status -128 is never listed
Thanks!
Christophe
Created 03-09-2017 12:05 PM
Hello,
This is related to https://issues.apache.org/jira/browse/NIFI-3530
Workaround https://hortonworks.jira.com/browse/BUG-66889?jql=text%20~%20%22hive%20metastore%20nifi%22
Patch to included in the next HDF release
Created 02-20-2017 03:55 PM
Update: running Wireshark:
CALL set_ugi seems to be successful,
Followed by CALL get_database which is not served, at this time the Hive metastore server RST the connections
Created 03-09-2017 12:05 PM
Hello,
This is related to https://issues.apache.org/jira/browse/NIFI-3530
Workaround https://hortonworks.jira.com/browse/BUG-66889?jql=text%20~%20%22hive%20metastore%20nifi%22
Patch to included in the next HDF release