question dose any of kafka version in HDP version need a zookeper server? in Support Questions

dose any of kafka version in HDP version need a zookeper server?

mike_bronson7 — Thu, 27 Jun 2019 19:01:53 GMT

hi all

We are using the hortonworks kits for our hadoop cluster ( HDP - 2.6.4 - HDP 3.1 )

I just wondering if any of kafka versions in HDP 2.X / 3.X must have a zookeeper servers??

maybe some kafka version can works without zookeeper??

Re: dose any of kafka version in HDP version need a zookeper server?

jsensharma — Thu, 27 Jun 2019 19:19:30 GMT

@Michael Bronson

Kafka uses zookeeper https://kafka.apache.org/documentation/#brokerconfigs , hence in HDP common services you will find that Kafka has a dependency to Zookeeper.

Example:

# grep -B4 -A4 'ZOOKEEPER' /var/lib/ambari-server/resources/common-services/KAFKA/0.8.1/metainfo.xml
          <versionAdvertised>true</versionAdvertised>
          <rollingRestartSupported>true</rollingRestartSupported>
          <dependencies>
            <dependency>
              <name>ZOOKEEPER/ZOOKEEPER_SERVER</name>
              <scope>cluster</scope>
              <auto-deploy>
                <enabled>true</enabled>
              </auto-deploy>
--
        <scriptType>PYTHON</scriptType>
        <timeout>300</timeout>
      </commandScript>
      <requiredServices>
        <service>ZOOKEEPER</service>
      </requiredServices>
      <configuration-dependencies>
        <config-type>kafka-broker</config-type>
        <config-type>kafka-env</config-type>

https://github.com/apache/ambari/blob/release-2.6.2/ambari-server/src/main/resources/common-services/KAFKA/0.8.1/metainfo.xml#L34-L42

Re: dose any of kafka version in HDP version need a zookeper server?

ask_bill_brooks — Tue, 02 Jul 2019 09:25:11 GMT

The above question and the entire response thread below was originally posted in the Community Help track. On Tue Jul 2 02:23 UTC 2019, a member of the HCC moderation staff moved it to the Data Ingestion & Streaming track. The Community Help Track is intended for questions about using the HCC site itself, not technical questions about Kafka dependancies on Zookeeper.