Member since
11-26-2018
3
Posts
0
Kudos Received
0
Solutions
01-10-2019
08:06 AM
Hi guys, I have a problem with deleting records/data from transactional table via beeline. Namely I am trying to carry on operation like this: delete from <table> where col = 222222222 Unfortunetely I have error related to metastore and locks. One of them looks like this: ERROR : FAILED: Hive Internal Error: org.apache.hadoop.hive.ql.lockmgr.LockException(Error communicating with the metastore) In the end i am getting below error Error: Attempt to unlock lock lockid:586779associated with an open transaction, Unlocking locks associated with transaction not permitted. lockid:586779 intLockId:1 txnid:219001 db:zdo table:cudo_test partition:null state:ACQUIRED type:SHARED_WRITE (state=,code=0) I have attached full log from those operation because few more errors are visible in there. My clue is updating metastore with some missing collumns which are crucial in txn operations, but I would like to advise somebody, if it could be proper approach.hive-txn-table-log.txt
... View more
Labels:
11-27-2018
06:55 AM
Yes, I have checked that. Everything looks fine from RM UI perspective. This situation occurs even, if no other process is submitted, so definetelly something is wrong. Some time ago we turn on transaction isolation. Could it have any influence?
... View more
11-26-2018
06:21 PM
Hi everyone, I am writing to you with following case. Namely It looks like that task where reduce steps are necessary doesnt work on tez under HDP 2.6.5. I base my question on simple example. 1. Connect to beeline through JDBC (!connect jdbc:hive2://<host>:<port>/default) 2. Hive.execution.engine=tez on default. When I am doing query like: Select count(*) from table everything works fine and gives results quickly. 3. The problem occurs when I want to perform actions with cluase as where. The query is hanging and nothing is happening with it. I even cannott see task on the YARN queue. Total vacuum ... Query is: Select count(*) from table where col1 = 'something' 4. Queries based just on the MAP works properly, so hence my conclusion that something is wrong with REDUCE at the level of processing through tez. Query: Select * from table where col1='something' 5. WhenI switch from hive.execution.engine=tez to hive.execution.engine=mr and perform query Select count(*) from table where col1 = 'something', the task is executed correctly. In relation to my lengthy story, I would like you to ask, if do you have any ideas why things like that could happen or what to do to run query properly under tez engine. Thank you very much for your help. Best regards, Hubert
... View more
Labels: