Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How can I monitor HDP 2.5 kafka cluster ?

How can I monitor HDP 2.5 kafka cluster ?

Explorer

I am running HDP 2.5.3 kafka cluster. I don't find any feature in ambari to monitor cluster like confluent control center provide. Is there any way I can set up confluent control center on my hdp?

1 REPLY 1
Highlighted

Re: How can I monitor HDP 2.5 kafka cluster ?

Super Collaborator

You can enable JMX for metrics + Grafana for visualization, then Ambari Infra for log collection

However, you will not have visibility into Consumer Lag like Confluent Control Center offers, and you will need to find some external tools to do that for you such as LinkedIn Burrow.

If you are not satisfied with that, Confluent Control Center can be added to an HDP cluster with manual setup.

https://docs.confluent.io/current/control-center/docs/installation/install-apache-kafka.html

You will need to copy the Confluent Metrics Reporter JARs from the Confluent Enterprise download over onto your HDP Kafka nodes under /usr/hdp/current/kafka

Don't have an account?
Coming from Hortonworks? Activate your account here