Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

dose any of kafka version in HDP version need a zookeper server?

Solved Go to solution

dose any of kafka version in HDP version need a zookeper server?


hi all


We are using the hortonworks kits for our hadoop cluster ( HDP - 2.6.4 - HDP 3.1 )

I just wondering if any of kafka versions in HDP 2.X / 3.X must have a zookeeper servers??

Or

maybe some kafka version can works without zookeeper??






Michael-Bronson
1 ACCEPTED SOLUTION

Accepted Solutions

Re: dose any of kafka version in HDP version need a zookeper server?

Super Mentor

@Michael Bronson

Kafka uses zookeeper https://kafka.apache.org/documentation/#brokerconfigs , hence in HDP common services you will find that Kafka has a dependency to Zookeeper.

Example:

# grep -B4 -A4 'ZOOKEEPER' /var/lib/ambari-server/resources/common-services/KAFKA/0.8.1/metainfo.xml
          <versionAdvertised>true</versionAdvertised>
          <rollingRestartSupported>true</rollingRestartSupported>
          <dependencies>
            <dependency>
              <name>ZOOKEEPER/ZOOKEEPER_SERVER</name>
              <scope>cluster</scope>
              <auto-deploy>
                <enabled>true</enabled>
              </auto-deploy>
--
        <scriptType>PYTHON</scriptType>
        <timeout>300</timeout>
      </commandScript>
      <requiredServices>
        <service>ZOOKEEPER</service>
      </requiredServices>
      <configuration-dependencies>
        <config-type>kafka-broker</config-type>
        <config-type>kafka-env</config-type>

.

https://github.com/apache/ambari/blob/release-2.6.2/ambari-server/src/main/resources/common-services...

2 REPLIES 2

Re: dose any of kafka version in HDP version need a zookeper server?

Super Mentor

@Michael Bronson

Kafka uses zookeeper https://kafka.apache.org/documentation/#brokerconfigs , hence in HDP common services you will find that Kafka has a dependency to Zookeeper.

Example:

# grep -B4 -A4 'ZOOKEEPER' /var/lib/ambari-server/resources/common-services/KAFKA/0.8.1/metainfo.xml
          <versionAdvertised>true</versionAdvertised>
          <rollingRestartSupported>true</rollingRestartSupported>
          <dependencies>
            <dependency>
              <name>ZOOKEEPER/ZOOKEEPER_SERVER</name>
              <scope>cluster</scope>
              <auto-deploy>
                <enabled>true</enabled>
              </auto-deploy>
--
        <scriptType>PYTHON</scriptType>
        <timeout>300</timeout>
      </commandScript>
      <requiredServices>
        <service>ZOOKEEPER</service>
      </requiredServices>
      <configuration-dependencies>
        <config-type>kafka-broker</config-type>
        <config-type>kafka-env</config-type>

.

https://github.com/apache/ambari/blob/release-2.6.2/ambari-server/src/main/resources/common-services...

Re: dose any of kafka version in HDP version need a zookeper server?

Community Manager

The above question and the entire response thread below was originally posted in the Community Help track. On Tue Jul 2 02:23 UTC 2019, a member of the HCC moderation staff moved it to the Data Ingestion & Streaming track. The Community Help Track is intended for questions about using the HCC site itself, not technical questions about Kafka dependancies on Zookeeper.

Bill Brooks, Community Manager
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.