Reply
Highlighted
Explorer
Posts: 12
Registered: ‎07-18-2016

java.net.SocketException: Connection reset while flume insert data into Hive tables

[ Edited ]

Hi,

 

I'll give little background about this. We are inserting data into hive tables using flume through Kite Sink. This is not streaming job. Flume is started using more memory than norma and suddenly we observed the below message in the flume logs.

sinkRunner -pollingRunner-DefaultSinkProcessor org.apache.hadoop.hive.metastore.HiveMetaStoreClient.Open
org.apache.thrift.transport.TTransportException:java.net.SocketException: Connection reset

 

Please see more error message in below screen shot.

 

HiveMetaStoreClient_issueConnection.PNGConnection reset

Why flume is connecting  to hive metastore while inserting data into hive tables through kite sink? 

Note: This is not streaming data.

 

Thanks

Yarra

Announcements
The Kite SDK is a collection of docs, sample code, APIs, and tools to make Hadoop application development faster. Learn more at http://kitesdk.org.