Support Questions

Find answers, ask questions, and share your expertise

java.net.SocketException: Connection reset while flume insert data into Hive tables

avatar
Explorer

Hi,

 

I'll give little background about this. We are inserting data into hive tables using flume through Kite Sink. This is not streaming job. Flume is started using more memory than norma and suddenly we observed the below message in the flume logs.

sinkRunner -pollingRunner-DefaultSinkProcessor org.apache.hadoop.hive.metastore.HiveMetaStoreClient.Open
org.apache.thrift.transport.TTransportException:java.net.SocketException: Connection reset

 

Please see more error message in below screen shot.

 

Connection resetConnection reset

Why flume is connecting  to hive metastore while inserting data into hive tables through kite sink? 

Note: This is not streaming data.

 

Thanks

Yarra

1 REPLY 1

avatar
New Contributor

Connection reset simply means that a TCP RST was received. This happens when your peer receives data that it can't process, and there can be various reasons for that. The simplest is when you close the socket, and then write more data on the output stream. By closing the socket, you told your peer that you are done talking, and it can forget about your connection. When you send more data on that stream anyway, the peer rejects it with an RST to let you know it isn't listening.