Support Questions
Find answers, ask questions, and share your expertise

Kafka connect


Hi all

How to setup kafka connect setup on ambari. If there is any procedure please let me know. my ambari version 3.1 and kafka i already installed in ambari with the 2.0  version. so now i need to setup kafka connect in ambari. 


Thanks in advance



After Kafka is deployed and running, validate the installation. You can use the command-line interface to create a Kafka topic, send test messages, and consume the messages.

  1. Click the Ambari "Services" tab.
  2. In the Ambari "Actions" menu, select "Add Service." This starts the Add Service wizard, displaying the Choose Services page. Some of the services are enabled by default.
  3. Scroll through the alphabetic list of components on the Choose Services page, and select "Kafka".
  4. Click Next to continue.
  5. On the Assign Masters page, review the node assignments for Kafka nodes.

    The following screen shows node assignment for a single-node Kafka cluster.

  6. If you want Kafka to run with high availability, you must assign more than one node for Kafka brokers, resulting in Kafka brokers running on multiple nodes.

    Click the "+" symbol to add more broker nodes to the cluster:

  7. Click Next to continue.
  8. On the Assign Slaves and Clients page, choose the nodes that you want to run ZooKeeper clients.
  9. Click Next to continue.
  10. Ambari displays the Customize Services page, which lists a series of services.

    For your initial configuration, you should use the default values set by Ambari. If Ambari prompts you with the message "Some configurations need your attention before you can proceed," review the list of properties and provide the required information.

    For information about optional settings that are useful in production environments, see Configuring Apache Kafka for a Production Environment.

  11. Click Next to continue.
  12. When the wizard displays the Review page, ensure that all HDP components correspond to HDP 2.5 or later.
  13. Click Deploy to begin the installation.
  14. Ambari displays the Install, Start and Test page. Monitor the status bar and messages for progress updates. When the wizard presents a summary of results, click "Complete" to finish installing Kafka.

I hope this information helps!



Hey Lewis

This is Kafka installation on ambari. but i need kafka connect on ambari.
; ;