Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hive job fail on TEZ due to out of memory..

Solved Go to solution
Highlighted

Hive job fail on TEZ due to out of memory..

Rising Star

Hi one of my job in hive on Tez gets fail at 98% due tojava.lang.OutOfMemoryError:Java heap space,

i am using HDP 2.1.2

i have below values

mapreduce.map.memory.mb=3584;

mapreduce.map.java.opts=-Xmx2560m;

mapreduce.reduce.memory.mb=3584;

mapreduce.reduce.java.opts=-Xmx2560m

Can any one help me to out this error is great appreciated..

Regards

sankar

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Hive job fail on TEZ due to out of memory..

Explorer

Your settings are mapreduce settings which may be not recognized by tez. Try setting tez config 'tez.task.resource.memory.mb' and 'tez.task.launch.cmd-opts' corresppondingly.

View solution in original post

5 REPLIES 5
Highlighted

Re: Hive job fail on TEZ due to out of memory..

Guru

@rama

did you try increasing your mappers memory? and is your request failing with hive.execution.engine=mr as well?

Re: Hive job fail on TEZ due to out of memory..

Explorer

Your settings are mapreduce settings which may be not recognized by tez. Try setting tez config 'tez.task.resource.memory.mb' and 'tez.task.launch.cmd-opts' corresppondingly.

View solution in original post

Highlighted

Re: Hive job fail on TEZ due to out of memory..

New Contributor

I had similar issues on the Sandbox 2.5, increased

hive.tez.container.size to 1024 and

hive.tez.java.opts to Xmx8192m OOM issues went away.

Highlighted

Re: Hive job fail on TEZ due to out of memory..

Rising Star

Thank you all i have increesed all the above values to 2mb more..now job is working fine..

Highlighted

Re: Hive job fail on TEZ due to out of memory..

Mentor

Please select the best answer to close out the thread

Don't have an account?
Coming from Hortonworks? Activate your account here