Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Kafka conumser lag in Ambari metric

Highlighted

Kafka conumser lag in Ambari metric

New Contributor

Hi,

We have Ambari 2.5.0.3.

I have been working on Kafka monitoring and I am trying to compare Ambari metric + Grafana with Kafka Manager from Yahoo.

One the important metrics in Kafka is consumer goup lag. In Grafana dashboard "Kafka - topics", there is consumer lag graph. This graph is always empty when a topic is selected (no data). Does someone have this dashboard working as expected ?

How to get consumer lag per consumer group for each topic in Ambari metric.

Thank you

1 REPLY 1

Re: Kafka conumser lag in Ambari metric

Rising Star

@Naveen R

The Consumer Lag graph under Fetcher Lag Metrics is actually lag for replica fetcher not the consumer lag per consumer group, as you can see the metric too for example is something like:

kafka.server.FetcherLagMetrics.ConsumerLag.clientId.ReplicaFetcherThread-0-1001.partition.0.topic.*

As for now we do not have specific graph in Grafana for consumer lag per consumer group.

Thank you.

Don't have an account?
Coming from Hortonworks? Activate your account here