Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

SAS connection issue with hive2

Highlighted

SAS connection issue with hive2

Explorer

Team,

 

A client is facing issue while trying to connect with the Hive... they have hourly, daily and weekly jobs that loading data to HDFS. 

 

As per their comment that few of the jobs can connect but mostly failed due to below issue. Below is the error that comes in the SAS job logs???

 

ERROR: java.util.concurrent.TimeoutException
Could not open connection to jdbc:hive2://XXXX:10000/ston. Check your Hive server status and also set option
SUBPROTOCOL= appropriately. Set SUBPROTOCOL=hive2 if you are running HiveServer2. Set SUBPROTOCOL=hive if you are running
Hive1.

 

 

As per SAS engineers, tThe error likely indicates a shortage of connections are available.  These values are the default ones that affect the number of connections:

 

hive.metastore.server.min.threads=200

hive.metastore.server.max.threads=100000

hive.server2.thrift.min.worker.threads=5

hive.server2.thrift.max.worker.threads=100

 

SAS uses 2 connections when connecting to Hive.  One primary connection and a secondary utility connection.  Both connections remain until a Libname connection is cleared.  The "hive.server2.thrift.max.worker.threads" property controls the number of connections which can be active at any one time...

 

 

Can anyone help me in this how we can resolve the issue, is there is any effect on changing the default values

 of hive.server2.thrift.max.worker.threads?

 

BR,

Salman

Don't have an account?
Coming from Hortonworks? Activate your account here