Hive job fail on TEZ due to out of memory..

[#1]

Hi one of my job in hive on Tez gets fail at 98% due tojava.lang.OutOfMemoryError:Java heap space,

i am using HDP 2.1.2

i have below values

mapreduce.map.memory.mb=3584;

mapreduce.map.java.opts=-Xmx2560m;

mapreduce.reduce.memory.mb=3584;

mapreduce.reduce.java.opts=-Xmx2560m

Can any one help me to out this error is great appreciated..

Regards

sankar

[#2]

@rama

did you try increasing your mappers memory? and is your request failing with hive.execution.engine=mr as well?

[#3 · Accepted solution]

Your settings are mapreduce settings which may be not recognized by tez. Try setting tez config 'tez.task.resource.memory.mb' and 'tez.task.launch.cmd-opts' corresppondingly.

[#4]

I had similar issues on the Sandbox 2.5, increased

hive.tez.container.size to 1024 and

hive.tez.java.opts to Xmx8192m OOM issues went away.

[#5]

Thank you all i have increesed all the above values to 2mb more..now job is working fine..

[#6]

Please select the best answer to close out the thread