Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Hive - Error while cleaning up the server resources, caused by org.apache.thrift.transport.TTransportException: org.apache.http.NoHttpResponseException: abc.com.net:10001 failed to respond

avatar

One of my talend package is failing when it tries to close the hive connection.

Here is the log snapshot:

[FATAL]: alpha.talendPackage - tHiveClose_1 Error while cleaning up the server resources
Exception in component tHiveClose_1
java.sql.SQLException: Error while cleaning up the server resources
	at org.apache.hive.jdbc.HiveConnection.close(HiveConnection.java:729)
	at alpha.talendPackage.tHiveClose_1Process(TalendPackage.java:3274)
	at alpha.talendPackage$1tRunJob_1Thread.run(TalendPackage.java:2983)
	at routines.system.ThreadPoolWorker.runIt(TalendThreadPool.java:159)
	at routines.system.ThreadPoolWorker.runWork(TalendThreadPool.java:150)
	at routines.system.ThreadPoolWorker.access$0(TalendThreadPool.java:145)
	at routines.system.ThreadPoolWorker$1.run(TalendThreadPool.java:122)
	at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.thrift.transport.TTransportException: org.apache.http.NoHttpResponseException: abc.com.net:10001 failed to respond
	at org.apache.thrift.transport.THttpClient.flushUsingHttpClient(THttpClient.java:297)
	at org.apache.thrift.transport.THttpClient.flush(THttpClient.java:313)
	at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:65)
	at org.apache.hive.service.cli.thrift.TCLIService$Client.send_CloseSession(TCLIService.java:173)
	at org.apache.hive.service.cli.thrift.TCLIService$Client.CloseSession(TCLIService.java:165)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.apache.hive.jdbc.HiveConnection$SynchronizedHandler.invoke(HiveConnection.java:1388)
	at com.sun.proxy.$Proxy9.CloseSession(Unknown Source)
	at org.apache.hive.jdbc.HiveConnection.close(HiveConnection.java:727)
	... 7 more

I verified the connectivity between Talend Server and Hive Server (abc.com.net:10001).

Also verified the connectivity on the cluster via Knox.

What really puzzles me is that it only fails for this particular talend job while the rest of the jobs are working absolutely fine.

Thanks in advance.

1 ACCEPTED SOLUTION

avatar
Expert Contributor

I would suggest you to delete the tHiveConnection and the tHiveClose, copy them from another job which is working, then give it a try , chck also your context values used by these 2 components.

also can you put a screenshot of your Job ?

Let me know

View solution in original post

2 REPLIES 2

avatar
Expert Contributor

I would suggest you to delete the tHiveConnection and the tHiveClose, copy them from another job which is working, then give it a try , chck also your context values used by these 2 components.

also can you put a screenshot of your Job ?

Let me know

avatar

Thank you for your guidance.

We found the issue to be with the timeout defined for tHiveClose. Since the job had multiple parallelize joblets, it result in this issue.

Appreciate your effort to help me.