Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Kafka connect

Highlighted

Kafka connect

Explorer

Hi all

How to setup kafka connect setup on ambari. If there is any procedure please let me know. my ambari version 3.1 and kafka i already installed in ambari with the 2.0  version. so now i need to setup kafka connect in ambari. 

 

Thanks in advance

2 REPLIES 2
Highlighted

Re: Kafka connect

Explorer

After Kafka is deployed and running, validate the installation. You can use the command-line interface to create a Kafka topic, send test messages, and consume the messages.

  1. Click the Ambari "Services" tab.
  2. In the Ambari "Actions" menu, select "Add Service." This starts the Add Service wizard, displaying the Choose Services page. Some of the services are enabled by default.
  3. Scroll through the alphabetic list of components on the Choose Services page, and select "Kafka".
  4. Click Next to continue.
  5. On the Assign Masters page, review the node assignments for Kafka nodes.

    The following screen shows node assignment for a single-node Kafka cluster.

  6. If you want Kafka to run with high availability, you must assign more than one node for Kafka brokers, resulting in Kafka brokers running on multiple nodes.

    Click the "+" symbol to add more broker nodes to the cluster:

  7. Click Next to continue.
  8. On the Assign Slaves and Clients page, choose the nodes that you want to run ZooKeeper clients.
  9. Click Next to continue.
  10. Ambari displays the Customize Services page, which lists a series of services.

    For your initial configuration, you should use the default values set by Ambari. If Ambari prompts you with the message "Some configurations need your attention before you can proceed," review the list of properties and provide the required information.

    For information about optional settings that are useful in production environments, see Configuring Apache Kafka for a Production Environment.

  11. Click Next to continue.
  12. When the wizard displays the Review page, ensure that all HDP components correspond to HDP 2.5 or later.
  13. Click Deploy to begin the installation.
  14. Ambari displays the Install, Start and Test page. Monitor the status bar and messages for progress updates. When the wizard presents a summary of results, click "Complete" to finish installing Kafka.

I hope this information helps!

Regards,

Lewis

Highlighted

Re: Kafka connect

Explorer
Hey Lewis

This is Kafka installation on ambari. but i need kafka connect on ambari.
Don't have an account?
Coming from Hortonworks? Activate your account here