Member since
11-26-2018
3
Posts
0
Kudos Received
0
Solutions
11-27-2018
06:55 AM
Yes, I have checked that. Everything looks fine from RM UI perspective. This situation occurs even, if no other process is submitted, so definetelly something is wrong. Some time ago we turn on transaction isolation. Could it have any influence?
... View more
11-26-2018
06:21 PM
Hi everyone, I am writing to you with following case. Namely It looks like that task where reduce steps are necessary doesnt work on tez under HDP 2.6.5. I base my question on simple example. 1. Connect to beeline through JDBC (!connect jdbc:hive2://<host>:<port>/default) 2. Hive.execution.engine=tez on default. When I am doing query like: Select count(*) from table everything works fine and gives results quickly. 3. The problem occurs when I want to perform actions with cluase as where. The query is hanging and nothing is happening with it. I even cannott see task on the YARN queue. Total vacuum ... Query is: Select count(*) from table where col1 = 'something' 4. Queries based just on the MAP works properly, so hence my conclusion that something is wrong with REDUCE at the level of processing through tez. Query: Select * from table where col1='something' 5. WhenI switch from hive.execution.engine=tez to hive.execution.engine=mr and perform query Select count(*) from table where col1 = 'something', the task is executed correctly. In relation to my lengthy story, I would like you to ask, if do you have any ideas why things like that could happen or what to do to run query properly under tez engine. Thank you very much for your help. Best regards, Hubert
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Tez