Support Questions
Find answers, ask questions, and share your expertise

Hive:- New client talking to old server. Continuing without it.org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection reset

Hive:- New client talking to old server. Continuing without it.org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection reset

Expert Contributor

51394-hive-query-failed.jpg

WARN hive.metastore: set_ugi() not successful, Likely cause: new client talking to old server. Continuing without it.
org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection reset


 INFO tool.ConnectorExportTool: com.teradata.connector.common.exception.ConnectorException: org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe
 at org.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.java:161)
 at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:65)
 at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_get_table(ThriftHiveMetastore.java:1212)
 at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table(ThriftHiveMetastore.java:1203)
 at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.tableExists(HiveMetaStoreClient.java:1274)
 at com.teradata.connector.hive.processor.HiveInputProcessor.inputPreProcessor(HiveInputProcessor.java:84)
 at com.teradata.connector.common.tool.ConnectorJobRunner.runJob(ConnectorJobRunner.java:115)
 at com.teradata.connector.common.tool.ConnectorExportTool.run(ConnectorExportTool.java:61)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
 at com.teradata.connector.common.tool.ConnectorExportTool.main(ConnectorExportTool.java:744)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:497)
 at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
 at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.net.SocketException: Broken pipe
 at java.net.SocketOutputStream.socketWrite0(Native Method)
 at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)<br>

Caused by: java.net.SocketException: Connection reset

2 REPLIES 2
Highlighted

Re: Hive:- New client talking to old server. Continuing without it.org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection reset

Expert Contributor
Error :- WARN hive.metastore: set_ugi() not successful, Likely cause: new client talking to old server. Continuing without it.
org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection reset

Reason of Failure :-

we get this error due to client connections is greater than hive.server2.thrift.max.worker.threads, HiveServer2 stops accepting new connections and ends up failed.

This should be handled more gracefully by the server and the JDBC driver, so that the end user gets aware of the problem and can take appropriate steps (either close existing connections or bump of the config value or use multiple server instances with dynamic service discovery enabled).

We should also review the behaviour of background thread pool to have a well defined behavior on the the pool getting exhausted.

Ideally implementing some form of general admission control will be a better solution, so that we do not accept new work unless sufficient resources are available and display graceful degradation under overload.

Increasing the Hive Thirft connection and recomendation :-

For Increasing the number Hive thirft connection, recommended to add New Hive Server 2 on another machine, instead of increasing by default 500 to some number in hive-site.xml

Highlighted

Re: Hive:- New client talking to old server. Continuing without it.org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection reset

New Contributor

Hi, for me, juste restarting all services in Ambari fixed the issue