Kafka CPU busy with GC

manoj_ramakrish — Thu, 05 May 2016 03:50:36 GMT

Anyone has seen kafka broker running into GC related CPU high ? We see it being 100%. And, we have no load on kafka. And, we see the following activity going on throughout that time :

[GC (Allocation Failure) 4.651: [ParNew: 272640K->7265K(306688K), 0.0277514 secs]272640K->7265K(1014528K), 0.0281243 secs] [Times: user=0.03 sys=0.05, real=0.03 secs]

There is a ticket here : https://issues.apache.org/jira/browse/KAFKA-2627

Heap memory setting on broker : java -Xmx1G -Xms1G -server -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC

Re: Kafka CPU busy with GC

cstanca — Tue, 27 Dec 2016 05:55:59 GMT

@Manoj Ramakrishnan

You should try to reduce the heap to the minimum required and also use g1gc. This is due to a GC tuning issue.

question Kafka CPU busy with GC in Archives of Support Questions (Read Only)

Kafka CPU busy with GC

Re: Kafka CPU busy with GC