Created on 11-02-2017 04:02 PM - edited 08-18-2019 12:55 AM
WARN hive.metastore: set_ugi() not successful, Likely cause: new client talking to old server. Continuing without it. org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection reset INFO tool.ConnectorExportTool: com.teradata.connector.common.exception.ConnectorException: org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe at org.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.java:161) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:65) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_get_table(ThriftHiveMetastore.java:1212) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table(ThriftHiveMetastore.java:1203) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.tableExists(HiveMetaStoreClient.java:1274) at com.teradata.connector.hive.processor.HiveInputProcessor.inputPreProcessor(HiveInputProcessor.java:84) at com.teradata.connector.common.tool.ConnectorJobRunner.runJob(ConnectorJobRunner.java:115) at com.teradata.connector.common.tool.ConnectorExportTool.run(ConnectorExportTool.java:61) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) at com.teradata.connector.common.tool.ConnectorExportTool.main(ConnectorExportTool.java:744) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: java.net.SocketException: Broken pipe at java.net.SocketOutputStream.socketWrite0(Native Method) at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)<br>
Caused by: java.net.SocketException: Connection reset
Created 01-17-2018 05:15 AM
Error :- WARN hive.metastore: set_ugi() not successful, Likely cause: new client talking to old server. Continuing without it. org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection reset
Reason of Failure :-
we get this error due to client connections is greater than hive.server2.thrift.max.worker.threads, HiveServer2 stops accepting new connections and ends up failed.
This should be handled more gracefully by the server and the JDBC driver, so that the end user gets aware of the problem and can take appropriate steps (either close existing connections or bump of the config value or use multiple server instances with dynamic service discovery enabled).
We should also review the behaviour of background thread pool to have a well defined behavior on the the pool getting exhausted.
Ideally implementing some form of general admission control will be a better solution, so that we do not accept new work unless sufficient resources are available and display graceful degradation under overload.
Increasing the Hive Thirft connection and recomendation :-
For Increasing the number Hive thirft connection, recommended to add New Hive Server 2 on another machine, instead of increasing by default 500 to some number in hive-site.xml
Created 12-12-2018 01:15 PM
Hi, for me, juste restarting all services in Ambari fixed the issue