05-02-2016 11:51 AM - edited 05-02-2016 12:24 PM
We recently started getting the GC warnings on our Yarn and all nodes of Production cluster frequently, so want to avoid this warnings. Please someone can help us to resolve this issue as soon as possible.
Following is the warning:
Test of whether this role spends too much time in garbage collection. Concerning
05-02-2016 03:19 PM
05-02-2016 04:19 PM
Which version of java are you using? I do not know much about GC tuning, but heap size can lead to GC pause sometimes, you can try to increaes the heap size of Node Manager if that is possible. You can also try to collect gc logs by adding java options temporarily "-XX:+PrintGCDetails -XX:+PrintHeapAtGC -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -XX:PrintFLSStatistics=2"
05-02-2016 04:41 PM - edited 05-02-2016 04:44 PM
Java version we are using is "1.8.0_51".
What property do we need to reset for increasing heap size.
05-02-2016 05:24 PM
you will need to append "
-Xms512m -Xmx1024m -XX:PermSize=216m -XX:MaxPermSize=512m
to the property Java Configuration Options for Node Manager, and then restart Node Managers. You'll want to change the numbers for -Xmx and -XX:MaxPermSize to values bigger than what you currently have for Node Manager. Please try to do this in a test enviroment first as this may impact on your production cluster.