11-13-2017 02:27 AM - last edited on 11-13-2017 05:42 AM by cjervis
We are getting warning (concerning) messages for mapreduce1 jobtracker frequently on our Cloudera CDH 5.9 cluster. Currently java heap size of jobtracker is 4.11GB and it's 14-node cluster.
Below is the warning message that appears regarding the garbage collection.
Test of whether this role spends too much time in garbage collection.
Concerning:Average time spent in garbage collection was 20.6 seconds(34.28%)per minute over the previous 5 minute(s).Warning threshold:30.00%
11-13-2017 07:58 AM
Try the below, it may help you
Cm -> Yarn -> Configuration -> "Java Heap Size of NodeManager in Bytes" Get the current value like 1GB or 2GB, etc... Increase one extra GB, ex: if it is 1GB, increase it to 2GB
Cm -> Yarn -> Configuration -> "Garbage Collection Duration Monitoring Period" Increase it from 5 mins to 10 mins
restart yarn as needed
11-14-2017 12:40 AM
11-14-2017 01:41 AM