Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 02-20-2017 03:42 PM
Hello,
While trying to ingest Data to Hive using Nifi - PutHiveStreaming. I'm stranded on the error while trying to connect to Hive Metastore.
HDP 2.5.3 / HDF 2.1.1 both kerberized
both technoted
https://community.hortonworks.com/articles/52856/stream-data-into-hive-like-a-king-using-nifi.html
and
have been applied to luck (While is wonder if the last one is still accurate with HDF2.1.1, however the error is present no matter with NAR file I use)
Extract of hivemetastore.log
2017-02-20 16:32:20,536 ERROR [pool-7-thread-195]: server.TThreadPoolServer (TThreadPoolServer.java:run(297)) - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Invalid status -128
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:609)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:606)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1704)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:606)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:269)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException: Invalid status -128
at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184)
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
... 10 more
Browsing the knowledge base of Google did not help, Status -128 is never listed
Thanks!
Christophe
Created 03-09-2017 12:05 PM
Hello,
This is related to https://issues.apache.org/jira/browse/NIFI-3530
Workaround https://hortonworks.jira.com/browse/BUG-66889?jql=text%20~%20%22hive%20metastore%20nifi%22
Patch to included in the next HDF release
Created 02-20-2017 03:55 PM
Update: running Wireshark:
CALL set_ugi seems to be successful,
Followed by CALL get_database which is not served, at this time the Hive metastore server RST the connections
Created 03-09-2017 12:05 PM
Hello,
This is related to https://issues.apache.org/jira/browse/NIFI-3530
Workaround https://hortonworks.jira.com/browse/BUG-66889?jql=text%20~%20%22hive%20metastore%20nifi%22
Patch to included in the next HDF release