09-21-2016 04:46 AM
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1473855979597_0004_m_000000_3: Error: Java heap space
How to increase the Heap size??
Please help me with correct steps .
09-22-2016 03:01 AM
this looks like your heap size error is thrown while executing a M/R job, right ?
Assuming you are using YARN, you should check the memory settings for map-reduce, like
as well as the general YARN container related ones, described by "Step 6" in the following brilliant guide:
At the end you have to adjust them based on your cluster resources.
10-17-2016 02:31 AM
We made the changes as per your instructions but still we are facing the same issue.
Also do we require to restart any service after making changes ??
10-18-2016 11:19 PM - edited 10-18-2016 11:24 PM
After chaning the heap size ,Yes you have to restart the service .
if you still have the problem Can you provide us the full stack trace.
Also try setting the Java heap size for Mapperr and Reducers to 75%
of mapreduce.map.memory.mb and mapreduce.reduce.
11-14-2016 02:07 PM
I've given some more clarification in the below link. Hope this helps