Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

How can I monitor HDP 2.5 kafka cluster ?

Explorer

I am running HDP 2.5.3 kafka cluster. I don't find any feature in ambari to monitor cluster like confluent control center provide. Is there any way I can set up confluent control center on my hdp?

1 REPLY 1

Super Collaborator

You can enable JMX for metrics + Grafana for visualization, then Ambari Infra for log collection

However, you will not have visibility into Consumer Lag like Confluent Control Center offers, and you will need to find some external tools to do that for you such as LinkedIn Burrow.

If you are not satisfied with that, Confluent Control Center can be added to an HDP cluster with manual setup.

https://docs.confluent.io/current/control-center/docs/installation/install-apache-kafka.html

You will need to copy the Confluent Metrics Reporter JARs from the Confluent Enterprise download over onto your HDP Kafka nodes under /usr/hdp/current/kafka

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.