Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Is it possible to add another Kafka broker to my cluster through Ambari?

avatar
Rising Star

The cluster was initially installed with the broker only on one node. Is there a way to install and register additional brokers in Ambari after the fact?

1 ACCEPTED SOLUTION

avatar

Yes - It is very easy to add another Kafka broker via the Ambari UI.

Step 1) From Ambari Home -> Hosts

Step 2) Select Host you would like to add the broker

171-screen-shot-2015-09-30-at-104233-am.png

Step 3) Select Add Kafka Broker

173-screen-shot-2015-09-30-at-104249-am.png

Step 4) Confirm you want to install Kafka Broker

Step 5) Sit back, crack open a beer and let Ambari do the rest!

View solution in original post

4 REPLIES 4

avatar

Yes. Go to Hosts from Ambari and you can click on Add Service at the bottom page. From the list of available services you can select kafka broker to be installed on that node.

avatar

Yes - It is very easy to add another Kafka broker via the Ambari UI.

Step 1) From Ambari Home -> Hosts

Step 2) Select Host you would like to add the broker

171-screen-shot-2015-09-30-at-104233-am.png

Step 3) Select Add Kafka Broker

173-screen-shot-2015-09-30-at-104249-am.png

Step 4) Confirm you want to install Kafka Broker

Step 5) Sit back, crack open a beer and let Ambari do the rest!

avatar
New Contributor

Thanks for the reply, it helped me a lot!

Unfortunately, when trying to apply this solution on our (secure) cluster, the installations hangs at "Install pending..." and looking at the ambari-server.log I see many errors like the following:

14 Mar 2016 12:54:03,430  INFO [qtp-ambari-client-21] AbstractResourceProvider:764 - Caught an exception while updating host components, retrying : java.lang.IllegalArgumentException: Missing KDC administrator credentials.

The KDC administrator credentials must be set as a persisted or temporary credential resource.This may be done by issuing a POST to the /api/v1/clusters/:clusterName/credentials/kdc.admin.credential API entry point with the following payload:
{
  "Credential" : {
    "principal" : "(PRINCIPAL)", "key" : "(PASSWORD)", "type" : "(persisted|temporary)"}
  }
}

I'm currently logged on to Ambari as a user with admin privileges.

I should also point out that when confirming the broker installation the popup also states that: "Because Kerberos has been manually installed on the cluster, you will have to create/distribute principals and keytabs when this operation is finished."

Thanks in advance for any help.

avatar
New Contributor

How can i assign the existing topic partition to newly added node ?