question Re: Missing kafka.consumer.* MBeans in Archives of Support Questions (Read Only)

Missing kafka.consumer.* MBeans

james_jones — Wed, 18 May 2016 20:41:45 GMT

What am I missing? I'm using JConsole connected to my Kafka 0.9.0 broker to find this:

kafka.consumer:type=ConsumerFetcherManager,name=MaxLag,clientId=([-.\w]+)

However, there is no kafka.consumer.* (nor kafka.producer.* for that matter).

Thanks.

Re: Missing kafka.consumer.* MBeans

schintalapani — Thu, 19 May 2016 06:37:40 GMT

@james.jones are you using high-level consumer api? http://kafka.apache.org/documentation.html#highlevelconsumerapi

Re: Missing kafka.consumer.* MBeans

james_jones — Thu, 19 May 2016 06:59:14 GMT

@schintalapani I believe it is the new am using the interface provided by this (http://kafka.apache.org/documentation.html#newconsumerapi).

	<dependency>
	    <groupId>org.apache.kafka</groupId>
	    <artifactId>kafka-clients</artifactId>
	    <version>0.9.0.0</version>
	</dependency>


org.apache.kafka.clients.consumer.KafkaConsumer<String,String>

However, I may be missing a fundamental point. I have mostly been looking at mbeans from the broker, not the client. I did run the client but still did not see kafka.consumer mbeans there either.

Re: Missing kafka.consumer.* MBeans

schintalapani — Thu, 19 May 2016 07:10:47 GMT

@james.jones the metric you are looking is for old high level consumer api. For the new consumer api can you use

kafka.consumer:type=consumer-fetch-manager-metrics,client-id=([-.w]+) and name=records-lag-max

Re: Missing kafka.consumer.* MBeans

james_jones — Thu, 19 May 2016 07:36:26 GMT

@schintalapani - Thanks! That's what I needed to know!

Re: Missing kafka.consumer.* MBeans

james_jones — Thu, 19 May 2016 07:41:21 GMT

I want to correct what I said above. On the client, kafka.consumer exists, but I was looking on the broker. And, the answer below is correct (newly named metric/Mbean is on the new consumer).