Created on 12-02-2016 05:22 PM - edited 08-19-2019 01:56 AM
Hi,
I'm trying to do a select count(*) from tweets; using Hive CLI. But as you can see, it is taking to much time (i guess)
It is normal?
Any tip?
Regards
Created 12-02-2016 05:54 PM
The Tez job has not started: both the mapper and the reducer are in "pending" state and haven't yet been launched. Once launched they would enter "running" state.
Check yarn to ensure there is enough room in your queue to fit the containers (http://sandbox:8088). There isn't much ram in a sandbox, and it could all be taken up by a Spark instance or by the Tez instances of hiveserver2.
Created 12-02-2016 07:04 PM
Never mind about cluster size. I saw you are using sandbox. Probably job cannot be started because there is not enough resource. You can try allocate more memory for VM or decrease tez container size.
Created 12-02-2016 07:10 PM
Zyang, what is the purpose about decreasing Tez Container Size?
Created 12-03-2016 12:02 AM
Your resource is limited. To solve the problem, either you allocate more resource or just request ask fro resource.
Created 12-02-2016 07:43 PM
Well Zyang, as you suggested i tried decreasing tez container size.
Now i got the following error
Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1480577643003_0005_1_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]Vertex killed, vertexName=Reducer 2, vertexId=vertex_1480577643003_0005_1_01, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE, failedTasks:0 killedTasks:1, Vertex vertex_1480577643003_0005_1_01 [Reducer 2] killed/failed due to:OTHER_VERTEX_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1
Any suggestion?
regards
Created 12-03-2016 12:06 AM
Map vertex get killed because Reduce vertex failed. Any log for reduce vertex?