Hive - Error while cleaning up the server resources, caused by org.apache.thrift.transport.TTransportException: org.apache.http.NoHttpResponseException: abc.com.net:10001 failed to respond

[#1]

One of my talend package is failing when it tries to close the hive connection.

Here is the log snapshot:

[FATAL]: alpha.talendPackage - tHiveClose_1 Error while cleaning up the server resources
Exception in component tHiveClose_1
java.sql.SQLException: Error while cleaning up the server resources
	at org.apache.hive.jdbc.HiveConnection.close(HiveConnection.java:729)
	at alpha.talendPackage.tHiveClose_1Process(TalendPackage.java:3274)
	at alpha.talendPackage$1tRunJob_1Thread.run(TalendPackage.java:2983)
	at routines.system.ThreadPoolWorker.runIt(TalendThreadPool.java:159)
	at routines.system.ThreadPoolWorker.runWork(TalendThreadPool.java:150)
	at routines.system.ThreadPoolWorker.access$0(TalendThreadPool.java:145)
	at routines.system.ThreadPoolWorker$1.run(TalendThreadPool.java:122)
	at java.lang.Thread.run(Unknown Source)
Caused by: org.apache.thrift.transport.TTransportException: org.apache.http.NoHttpResponseException: abc.com.net:10001 failed to respond
	at org.apache.thrift.transport.THttpClient.flushUsingHttpClient(THttpClient.java:297)
	at org.apache.thrift.transport.THttpClient.flush(THttpClient.java:313)
	at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:65)
	at org.apache.hive.service.cli.thrift.TCLIService$Client.send_CloseSession(TCLIService.java:173)
	at org.apache.hive.service.cli.thrift.TCLIService$Client.CloseSession(TCLIService.java:165)
	at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.apache.hive.jdbc.HiveConnection$SynchronizedHandler.invoke(HiveConnection.java:1388)
	at com.sun.proxy.$Proxy9.CloseSession(Unknown Source)
	at org.apache.hive.jdbc.HiveConnection.close(HiveConnection.java:727)
	... 7 more

I verified the connectivity between Talend Server and Hive Server (abc.com.net:10001).

Also verified the connectivity on the cluster via Knox.

What really puzzles me is that it only fails for this particular talend job while the rest of the jobs are working absolutely fine.

Thanks in advance.

[#2 · Accepted solution]

I would suggest you to delete the tHiveConnection and the tHiveClose, copy them from another job which is working, then give it a try , chck also your context values used by these 2 components.

also can you put a screenshot of your Job ?

Let me know

[#3]

Thank you for your guidance.

We found the issue to be with the timeout defined for tHiveClose. Since the job had multiple parallelize joblets, it result in this issue.

Appreciate your effort to help me.