Created on 03-26-2018 07:29 AM - edited 09-16-2022 06:02 AM
java.pngi am trying to execute a tez job on hive and it is starting the task but is continuously failing saying java lang runtime exception: java out of memory exception.
also vertex of the dag failed due to the own task failure.
i am trying a very simple task using tez and also tried to increase the container size still the problem persists.
Created 03-26-2018 07:43 AM
Created 03-26-2018 07:50 AM
Created 03-26-2018 08:40 AM
can you share values for hive.tez.container.size and hive.tez.java.opts, tez.runtime.io.sort.mb, tez.runtime.unordered.output.buffer.size-mb.
Created 03-26-2018 09:10 AM
tez.runtime.unordered.output.buffer.size-mb = 844mb
Created 03-26-2018 09:23 AM
Created 03-26-2018 09:24 AM
Can you try with below settings?
set tez runtime.io.sort.mb=512;
Created 03-26-2018 10:00 AM
i tried with the parameters that you have mentioned, still the problem persists
Created 03-27-2018 04:47 PM
Can you send the below details from your cluster:
# free -m
By any chance are you using the sandbox ?