Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Error in Hive - Tez

Solved Go to solution
Highlighted

Error in Hive - Tez

Hi all,

I am getting this error in Hive

info=[Error: Failure while running task:java.lang.IllegalArgumentException: tez.runtime.io.sort.mb 2027 should be larger than 0 and should be lessthan the available task memory (MB):538

Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:12, Vertex vertex_1496756949291_0733_1_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]Verte killed, vertexName=Reducer 2, vertexId=vertex_1496756949291_0733_1_01, diagnostics=[Vertex received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTX_FAILURE, failedTasks:0 killedTasks:101, Vertex vertex_1496756949291_0733_1_01 [Reducer 2] killed/failed due to:OTHER_VERTEX_FAILURE]DAG did not succeed due to VERTEX_FAIURE. failedVertices:1 killedVertices:1

I am getting the error by using this "select ordernum, count(*) from status group by ordernum having count(*) > 1;"

I've set tez.runtime.io.sort.mb = 2027 to tez.runtime.io.sort.mb = 409 but I still getting the same error tez.runtime.io.sort.mb 2027

Please help.

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Error in Hive - Tez

Contributor

If the query is run over hive cli it should have worked. In case it is beeline or other clients accessing hiveserver you have to restart the server for property to get updated. If the cluster is managed via ambari it will be optimal to update it there since ambari will list the services that need a restart

View solution in original post

3 REPLIES 3
Highlighted

Re: Error in Hive - Tez

Contributor

If the query is run over hive cli it should have worked. In case it is beeline or other clients accessing hiveserver you have to restart the server for property to get updated. If the cluster is managed via ambari it will be optimal to update it there since ambari will list the services that need a restart

View solution in original post

Highlighted

Re: Error in Hive - Tez

I restarted the cluster and it worked. Thanks

Re: Error in Hive - Tez

Contributor

Thats nice!! Appreciate if you could accept the answer.

Don't have an account?
Coming from Hortonworks? Activate your account here