question Re: Hive job fail on TEZ due to out of memory.. in Support Questions

Hive job fail on TEZ due to out of memory..

g_rao9704 — Thu, 24 Nov 2016 20:34:32 GMT

Hi one of my job in hive on Tez gets fail at 98% due tojava.lang.OutOfMemoryError:Java heap space,

i am using HDP 2.1.2

i have below values

mapreduce.map.memory.mb=3584;

mapreduce.map.java.opts=-Xmx2560m;

mapreduce.reduce.memory.mb=3584;

mapreduce.reduce.java.opts=-Xmx2560m

Can any one help me to out this error is great appreciated..

Regards

sankar

Re: Hive job fail on TEZ due to out of memory..

ledel — Fri, 25 Nov 2016 01:52:18 GMT

@rama

did you try increasing your mappers memory? and is your request failing with hive.execution.engine=mr as well?

Re: Hive job fail on TEZ due to out of memory..

zyang — Fri, 02 Dec 2016 16:20:50 GMT

Your settings are mapreduce settings which may be not recognized by tez. Try setting tez config 'tez.task.resource.memory.mb' and 'tez.task.launch.cmd-opts' corresppondingly.

Re: Hive job fail on TEZ due to out of memory..

david1 — Sat, 03 Dec 2016 07:59:07 GMT

I had similar issues on the Sandbox 2.5, increased

hive.tez.container.size to 1024 and

hive.tez.java.opts to Xmx8192m OOM issues went away.

Re: Hive job fail on TEZ due to out of memory..

g_rao9704 — Fri, 09 Dec 2016 14:57:49 GMT

Thank you all i have increesed all the above values to 2mb more..now job is working fine..

Re: Hive job fail on TEZ due to out of memory..

aervits — Sat, 10 Dec 2016 22:25:13 GMT

Please select the best answer to close out the thread