hive CTAS using jdbc hangs.

[#1]

I am trying to create a hive table using another hive table using a simple JDBC program. This some times hangs the hive. when this happens all other sqls(select/insert/delete... etc.) through the other jdbc program are aslo hanging, but I could execute the same sqls through other hive client interfaces like sql workbench, sql developer etc.

here are the sqls 1> CREATE TABLE XXXX AS SELECT * FROM XXXX WHERE 1=2 2> ANALYZE TABLE XXXX COMPUTE STATISTICS -- not sure if this is causing issue, just pasting here

This may not happen every time, need to keep trying for few times with different table.

The work around is, is to reboot the entire hadoop cluster, stoping just the hive service alone will not help. I dont see any error message in the hive/hadoop log files.

Environment:

1> Hive version 1.2.1000.2.5.0.0-1245

2> HDP version 2.5.0.0-1245

3> Jdbc jars hive-jdbc-1.2.1.jar,httpmime-4.1.3.jar,httpclient-4.3.3.jar,httpcore-4.3.jar,hive-service-2.0.0.jar, hadoop-core-0.20.2.jar,hive-common-0.8.0.jar,hive_metastore.jar,libthrift-0.9.0.jar

Appriciate your help.

[#2]

Start by look into the container sizing and queues configuration. Seems the container serving JDBC is either not getting enough resource or is hanging. Check your yarn logs for the application id running JDBC (thrift) process.