Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Getting stuck on hive error" DEBUG lockmgr.DummyTx

avatar
Explorer

Hi,

 

In Hadoop, while creating Table in hive i am getting stuck in below error

 

15/04/21 12:35:34 INFO log.PerfLogger: <PERFLOG method=Driver.run from=org.apache.hadoop.hive.ql.Driver>
15/04/21 12:35:34 INFO log.PerfLogger: <PERFLOG method=TimeToSubmit from=org.apache.hadoop.hive.ql.Driver>
15/04/21 12:35:34 INFO log.PerfLogger: <PERFLOG method=acquireReadWriteLocks from=org.apache.hadoop.hive.ql.Driver>
15/04/21 12:35:34 INFO lockmgr.DummyTxnManager: Creating lock manager of type org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager
15/04/21 12:35:34 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=dkhc3013.dcsg.com:2181,dkhc3010.dcsg.com:2181,dkhc3011.dcsg.com:2181 sessionTimeout=600000 watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@5b9e1cd4
15/04/21 12:35:34 DEBUG lockmgr.DummyTxnManager: Adding /incoming/mkt/gcdb.etl_master_account_pref to list of lock inputs
15/04/21 12:35:34 DEBUG lockmgr.DummyTxnManager: Adding database:mkt_incoming to list of lock outputs


After restart the zookeeper service i am able to successfully run the query,

But after some time again facing the same issue/error, I am stuck on the same error.

 

is there any solution to overcome this issue, or any tuning i can do for resolve this issue.

 

Please suggest on this.

1 ACCEPTED SOLUTION

avatar
Super Guru
This seems similar to this problems of ZooKeeper leaks with HiveServer2
https://issues.apache.org/jira/browse/HIVE-9119

Hue is also not closing the Hive queries, so you could try to bump the
number of connections/clients in CM?

Also check
http://gethue.com/hadoop-tutorial-hive-and-impala-queries-life-cycle/

Romain

View solution in original post

3 REPLIES 3

avatar
Super Guru
This seems similar to this problems of ZooKeeper leaks with HiveServer2
https://issues.apache.org/jira/browse/HIVE-9119

Hue is also not closing the Hive queries, so you could try to bump the
number of connections/clients in CM?

Also check
http://gethue.com/hadoop-tutorial-hive-and-impala-queries-life-cycle/

Romain

avatar
Explorer

resolved

 

 

avatar
Explorer

 

Resolved