Reply
Champion Alumni
Posts: 196
Registered: ‎11-18-2014

Hive- Java Heap Memory or sucessful operation (got randomly) with the same data

Hello,

 

I'm having some ETL queries that I put in oozie workflow. 

However, from time to time  (30% of cases) I get a Java Heap Memory. In the rest of the cases I have a sucessful result.

I never run multiple workflows in the same time so there should be exactly the same process runing. 

 

 

Where should I look in order to solve this? I tried to increase the java heap for clients/ for metastore. Still the same thing. 

 

Thank you!!

 

GHERMAN Alina
Highlighted
Expert Contributor
Posts: 126
Registered: ‎11-01-2013

Re: Hive- Java Heap Memory or sucessful operation (got randomly) with the same data

Check your process limits at the OS level
Em Jay
Expert Contributor
Posts: 126
Registered: ‎11-01-2013

Re: Hive- Java Heap Memory or sucessful operation (got randomly) with the same data

check your ulimits and increase the numbers if you think needed
Em Jay