Support Questions
Find answers, ask questions, and share your expertise

dose any of kafka version in HDP version need a zookeper server?

Solved Go to solution

dose any of kafka version in HDP version need a zookeper server?


hi all


We are using the hortonworks kits for our hadoop cluster ( HDP - 2.6.4 - HDP 3.1 )

I just wondering if any of kafka versions in HDP 2.X / 3.X must have a zookeeper servers??

Or

maybe some kafka version can works without zookeeper??






Michael-Bronson
1 ACCEPTED SOLUTION

Accepted Solutions

Re: dose any of kafka version in HDP version need a zookeper server?

Super Mentor

@Michael Bronson

Kafka uses zookeeper https://kafka.apache.org/documentation/#brokerconfigs , hence in HDP common services you will find that Kafka has a dependency to Zookeeper.

Example:

# grep -B4 -A4 'ZOOKEEPER' /var/lib/ambari-server/resources/common-services/KAFKA/0.8.1/metainfo.xml
          <versionAdvertised>true</versionAdvertised>
          <rollingRestartSupported>true</rollingRestartSupported>
          <dependencies>
            <dependency>
              <name>ZOOKEEPER/ZOOKEEPER_SERVER</name>
              <scope>cluster</scope>
              <auto-deploy>
                <enabled>true</enabled>
              </auto-deploy>
--
        <scriptType>PYTHON</scriptType>
        <timeout>300</timeout>
      </commandScript>
      <requiredServices>
        <service>ZOOKEEPER</service>
      </requiredServices>
      <configuration-dependencies>
        <config-type>kafka-broker</config-type>
        <config-type>kafka-env</config-type>

.

https://github.com/apache/ambari/blob/release-2.6.2/ambari-server/src/main/resources/common-services...

View solution in original post

2 REPLIES 2

Re: dose any of kafka version in HDP version need a zookeper server?

Super Mentor

@Michael Bronson

Kafka uses zookeeper https://kafka.apache.org/documentation/#brokerconfigs , hence in HDP common services you will find that Kafka has a dependency to Zookeeper.

Example:

# grep -B4 -A4 'ZOOKEEPER' /var/lib/ambari-server/resources/common-services/KAFKA/0.8.1/metainfo.xml
          <versionAdvertised>true</versionAdvertised>
          <rollingRestartSupported>true</rollingRestartSupported>
          <dependencies>
            <dependency>
              <name>ZOOKEEPER/ZOOKEEPER_SERVER</name>
              <scope>cluster</scope>
              <auto-deploy>
                <enabled>true</enabled>
              </auto-deploy>
--
        <scriptType>PYTHON</scriptType>
        <timeout>300</timeout>
      </commandScript>
      <requiredServices>
        <service>ZOOKEEPER</service>
      </requiredServices>
      <configuration-dependencies>
        <config-type>kafka-broker</config-type>
        <config-type>kafka-env</config-type>

.

https://github.com/apache/ambari/blob/release-2.6.2/ambari-server/src/main/resources/common-services...

View solution in original post

Re: dose any of kafka version in HDP version need a zookeper server?

The above question and the entire response thread below was originally posted in the Community Help track. On Tue Jul 2 02:23 UTC 2019, a member of the HCC moderation staff moved it to the Data Ingestion & Streaming track. The Community Help Track is intended for questions about using the HCC site itself, not technical questions about Kafka dependancies on Zookeeper.

Bill Brooks, Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.