Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Hive Metastore aborted transaction loop

avatar
Contributor

Hello

Just upgraded to HDP 2.5.3 from HDP 2.3.6 and experiencing lots of problems. One for instance is that the 3 Hive metastores that I've running for HA sake are printing this to the metastore.log like crazy every few milliseconds:

2017-02-16 13:58:01,341 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2960)) - Aborted 0 transactions due to timeout
2017-02-16 13:58:01,345 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2949)) - Aborted the following transactions due to timeout: []
2017-02-16 13:58:01,345 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2960)) - Aborted 0 transactions due to timeout
2017-02-16 13:58:01,350 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2949)) - Aborted the following transactions due to timeout: []
2017-02-16 13:58:01,350 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2960)) - Aborted 0 transactions due to timeout
2017-02-16 13:58:01,354 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2949)) - Aborted the following transactions due to timeout: []
2017-02-16 13:58:01,354 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2960)) - Aborted 0 transactions due to timeout
2017-02-16 13:58:01,359 INFO  [org.apache.hadoop.hive.ql.txn.AcidHouseKeeperService-0]: txn.TxnHandler (TxnHandler.java:performTimeOuts(2949)) - Aborted the following transactions due to timeout: []

I cannot find anything pointing to the cause of this problem. Any hint?

1 ACCEPTED SOLUTION

avatar
Super Collaborator

This has been fixed in https://issues.apache.org/jira/browse/HIVE-15181. In the meantime you can

set hive.direct.sql.max.query.length=1;set 

hive.direct.sql.max.elements.in.clause=1000;

for the Standalone Metastore process(es).

View solution in original post

2 REPLIES 2

avatar
Super Collaborator

This has been fixed in https://issues.apache.org/jira/browse/HIVE-15181. In the meantime you can

set hive.direct.sql.max.query.length=1;set 

hive.direct.sql.max.elements.in.clause=1000;

for the Standalone Metastore process(es).

avatar
Contributor

Thanks! It worked! I put the in Ambari in custom-hive-site, restarted the affected services and no more noise.