Support Questions
Find answers, ask questions, and share your expertise

TezTask Error task memory while running task

Explorer

Hi you,

I'm facing with these error:

Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1477624725642_0102_1_00, diagnostics=[Task failed, taskId=task_1477624725642_0102_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : attempt_1477624725642_0102_1_00_000000_0:java.lang.IllegalArgumentException: tez.runtime.io.sort.mb 300 should be larger than 0 and should be less than the available task memory (MB):174

If I decrease tez.runtime.io.sort.mb < 300 , It's ok.

But how I can increase "task memory" ?

Thanks in advance,

3 REPLIES 3

@Tran Quyet Thang

to increase the task memory you need to increase the task.container.size.

@Tran Quyet Thang

Try to change tez.runtime.io.sort.mb to a value between 0 and 174. You could try with 128 for example.

Contributor

For increasing "task memory" you can use, "tez.task.resource.memory.mb". If you are running the job via hive, you can use "hive --hiveconf hive.tez.container.size=1024"