Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Hive Metastore aborted transaction loop

Explorer

Hello

Just upgraded to HDP 2.5.3 from HDP 2.3.6 and experiencing lots of problems. One for instance is that the 3 Hive metastores that I've running for HA sake are printing this to the metastore.log like crazy every few milliseconds:

2017-02-16 13:58:01,341 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2960)) - Aborted 0 transactions due to timeout
2017-02-16 13:58:01,345 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2949)) - Aborted the following transactions due to timeout: []
2017-02-16 13:58:01,345 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2960)) - Aborted 0 transactions due to timeout
2017-02-16 13:58:01,350 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2949)) - Aborted the following transactions due to timeout: []
2017-02-16 13:58:01,350 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2960)) - Aborted 0 transactions due to timeout
2017-02-16 13:58:01,354 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2949)) - Aborted the following transactions due to timeout: []
2017-02-16 13:58:01,354 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2960)) - Aborted 0 transactions due to timeout
2017-02-16 13:58:01,359 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2949)) - Aborted the following transactions due to timeout: []

I cannot find anything pointing to the cause of this problem. Any hint?

1 ACCEPTED SOLUTION

Expert Contributor

This has been fixed in https://issues.apache.org/jira/browse/HIVE-15181. In the meantime you can

set hive.direct.sql.max.query.length=1;set 

hive.direct.sql.max.elements.in.clause=1000;

for the Standalone Metastore process(es).

View solution in original post

2 REPLIES 2

Expert Contributor

This has been fixed in https://issues.apache.org/jira/browse/HIVE-15181. In the meantime you can

set hive.direct.sql.max.query.length=1;set 

hive.direct.sql.max.elements.in.clause=1000;

for the Standalone Metastore process(es).

Explorer

Thanks! It worked! I put the in Ambari in custom-hive-site, restarted the affected services and no more noise.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.