The titled  SocketTimeoutException occurs when the thrift-client in hiveConnection object is in the process of actively reading sql results from  hive server2 ( thrift server), and is not able to receive anything until the TSocket's time out occurs.  You can check the source code from:HiveConnection.setupLoginTimeout and HiveAuthFactory.getSocketTransport. So you need to either tuning hiveserver2, or increase the TSocket's timeout setting. And for now, the only way to increase Tsocket's time out setting is via: DriverManager.setLoginTimeout()   you can check below jira for more information: https://issues.apache.org/jira/browse/HIVE-22196 https://issues.apache.org/jira/browse/HIVE-6679 https://issues.apache.org/jira/browse/HIVE-12371 ... View more

nope. I didn't use any custom/auxiliary jars.   I am not very sure about how jars are loaded when using spark execution engine for hive, but i do notice that class path are tailored by /opt/cloudera/parcels/CDH/lib/hive/bin/hive, as below shows, to add spark related jars, while this have nothing to do with antlr-runtime-xx.jar or antlr4-runtime-xx.jar: (so i am confused why this happens for hive on spark while not for hive on mr?)   # add Spark jars to the classpath if [[ -n "$SPARK_HOME" ]] then CLASSPATH=${CLASSPATH}:${SPARK_HOME}/jars/spark-core*.jar CLASSPATH=${CLASSPATH}:${SPARK_HOME}/jars/spark-unsafe*.jar CLASSPATH=${CLASSPATH}:${SPARK_HOME}/jars/scala-library*.jar fi ... View more

just a add on:   the underneath class that caused the problem, which is org/antlr/runtime/tree/CommonTree, can't be found in antlr4-runtime-xxx.jar, but can be found in antlr-runtime-xxx.jar, as below screen shows： So we copied antlr-runtime-xxx.jar from the standard lib of hive into the standard jar lib of spark, our issue seems to be resolved by this.    ... View more