Reply
Highlighted
New Contributor
Posts: 2
Registered: ‎06-17-2014

hive service hangs frequently

Hi team,

i faced a scenario, where i am using Hiveservice with HS2. usually the hiveservice hangs intermittently.
I found nothing in logs. But when i saw zookeeper logs i see following error0

"WARN org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from /X.X.X.X - max is 30"

I tried to increase this value to 60. it worked for some days, again i faced same problem Hive Service(HS) is not responding.
I tried to increase this value to 120. it worked for some days, again i faced same problem Hive Service(HS) is not responding.

 

I see the same logs -

 

"WARN org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from /X.X.X.X - max is 120"

So just wondering - Is "increasing the zookeeper client connection limit"  is the only way to resolve this problem ??

I find some few blogs where cloudera has posted on this. But no clear picture on the above issue resolution.

http://gethue.com/hadoop-tutorial-hive-and-impala-queries-life-cycle/
http://community.cloudera.com/t5/Batch-SQL-Apache-Hive/hiveserver2-fails-to-release-zookeeper-connec...
https://issues.apache.org/jira/browse/HIVE-4132
https://groups.google.com/a/cloudera.org/forum/#!searchin/hue-user/zookeeper$2C
https://groups.google.com/a/cloudera.org/forum/#!searchin/hue-user/zookeeper$2C/hue-user/DJFiSYwETtk...

Can you pls suggest.