Cloudera Navigator Metadata Server Java Heap Size by default is only 2 GB. We have changed this to 20GB already and Metadata server still crashes with unexpected exits.
stdout.log has following entry
# java.lang.OutOfMemoryError: PermGen space
# Executing /bin/sh -c "/usr/lib64/cmf/service/common/killparent.sh"...
How to calculate (based on which factors) how much memory to allocate?
Looks like there is memory leak issue. Following warning is in the logs. Anyone has any ideas on how to resolve this?
A C3P0Registry mbean is already registered. This probably means that an application using c3p0 was undeployed, but not all PooledDataSources were closed prior to undeployment. This may lead to resource leaks over time. Please take care to close all PooledDataSources.
We were increasing Heap size but OOM error is related to PermGen space and not Heap space.
Added the option XX:MaxPermSize=2048m
Hopefully this will resolve. Monitoring....
We are facing the same problem. The service autorestarts and creates multiple headDumps on /tmp/ of ~3Gb.
Well spot that the OOM-error is occuring due to PermGen. The default value for all mgnt-services is
We have boosted it up a bit to 256 and increase the heap as well.
Here is a link to the Cloudera Recommendation:
Formula = (elements + relations) * 200. You can find these in the logs:
grep NavServerUtil /pathtologs/cloudera-scm-navigator/*
In our case 3 Gb heap should be more than enough