Created 11-02-2018 01:53 AM
Hi there,
In my dev cluster, we are running Kafka, however when I check in grafana, the fetch consumer total time graph is empty, there are a few other graphs which are empty as well, anyway to get the data?
Thanks,
Created 11-02-2018 02:09 AM
Can you please try removing the "kafka.network.RequestMetrics" from the "Advanced kafka-broker" property in the Ambari UI "external.kafka.metrics.exclude.prefix" .
Then restart the Kafka Brokers then wait for 3-5 minutes and then check the graph again.
Default Value should be as following:
external.kafka.metrics.exclude.prefix = kafka.network.RequestMetrics,kafka.server.DelayedOperationPurgatory,kafka.server.BrokerTopicMetrics.BytesRejectedPerSec,kafka.server.KafkaServer.ClusterId
.
Please try changing it to following:
external.kafka.metrics.exclude.prefix = kafka.server.DelayedOperationPurgatory,kafka.server.BrokerTopicMetrics.BytesRejectedPerSec,kafka.server.KafkaServer.ClusterId
.
Also based on your requirement you can include or exclude some more metrics of Kafka. Please take a look at the other relative property "external.kafka.metrics.include.prefix"
.
Created 11-02-2018 02:09 AM
Can you please try removing the "kafka.network.RequestMetrics" from the "Advanced kafka-broker" property in the Ambari UI "external.kafka.metrics.exclude.prefix" .
Then restart the Kafka Brokers then wait for 3-5 minutes and then check the graph again.
Default Value should be as following:
external.kafka.metrics.exclude.prefix = kafka.network.RequestMetrics,kafka.server.DelayedOperationPurgatory,kafka.server.BrokerTopicMetrics.BytesRejectedPerSec,kafka.server.KafkaServer.ClusterId
.
Please try changing it to following:
external.kafka.metrics.exclude.prefix = kafka.server.DelayedOperationPurgatory,kafka.server.BrokerTopicMetrics.BytesRejectedPerSec,kafka.server.KafkaServer.ClusterId
.
Also based on your requirement you can include or exclude some more metrics of Kafka. Please take a look at the other relative property "external.kafka.metrics.include.prefix"
.
Created 11-02-2018 02:24 AM
THanks for the reply @Jay Kumar SenSharma, it helps! I will try to play around with the config to find out what magic they do.