Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

yarn java outofmemory

yarn java outofmemory

New Contributor
Hi,
I have a cluster of 5 servers, with 16 gb of memory. When I submit jobs to yarn (through hue/oozie/pig), it seems as alot of them are getting out of memory exception for java heap memory. Increasing the memory through cloudera configuration did reduce the amount of mappers/reducers failing, however there still are a few. Also note the input working on is only around 10gb, which is very small.
Also, if it matters, it seems the cloudera server service is sometimes also crashing when submitting jobs thriugh the same process. I found no logs to this though, and it is also less important to me currently.

Thanks, Matan.
1 REPLY 1

Re: yarn java outofmemory

Master Guru
Could you post a few stack traces of the failed logs here?

What are your Map and Reduce task heap memory settings set to?