Support Questions
Find answers, ask questions, and share your expertise

Storm bolt is not connected with Kafka look like some error

Highlighted

Re: Storm bolt is not connected with Kafka look like some error

Mentor

@Shahzad Aslam :) go through the document I provided to complete the assignment.

Re: Storm bolt is not connected with Kafka look like some error

Mentor

@Shahzad Aslam

then take a look at storm user guide official docs on our docs page, specifically for kafka spout.

Highlighted

Re: Storm bolt is not connected with Kafka look like some error

Explorer

i guess i am using the same code as mentioned in kafka spout link

Highlighted

Re: Storm bolt is not connected with Kafka look like some error

Cloudera Employee

Even master branch of Apache Storm depends on Apache Curator 2.9.0 and Apache Zookeeper 3.4.6. Please refer https://github.com/apache/storm/blob/master/pom.xml and see curator.version and zookeeper.version.

Your stack trace says there's Apache Curator 3.0.0 in classpath which seems to depend on Apache Zookeeper 3.5.0 or higher. But your classpath seems not contain Apache Zookeeper 3.5.0 or higher.

Method "org.apache.zookeeper.server.quorum.flexible.QuorumMaj.<init>(Ljava/util/Map;)V" was introduced to Zookeeper 3.5.0. Please refer https://github.com/apache/zookeeper/commit/d7b7042543daa4f6b6d9f5c80911573b07ad297a and see tags.

You may want to check dependency graph for pom.xml in your project, and remove any custom dependencies regarding Curator and Zookeeper so that Storm itself's dependencies take effect.

For avoiding version mismatch, I'd like to suggest you match version of storm-core and storm-kafka.

Highlighted

Re: Storm bolt is not connected with Kafka look like some error

Mentor

@Shahzad Aslam has this been resolved? Can you post your solution or accept best answer?

Highlighted

Re: Storm bolt is not connected with Kafka look like some error

New Contributor

+1, please share.

Highlighted

Re: Storm bolt is not connected with Kafka look like some error

Guru

The no such method exception is usually a version conflict. Check to make sure that the versions in your pom.xml for Storm, Kafka, Zookeeper are the correct versions for your version of HDP. These dependency settings work in HDP 2.3.2.

<dependencies>

    <dependency>

		<groupId>org.apache.storm</groupId>

		<artifactId>storm-core</artifactId>

		<version>0.10.0</version>

		<scope>provided</scope>

		<exclusions>

			<exclusion> 

    			<groupId>org.slf4j</groupId>

    			<artifactId>slf4j-log4j12</artifactId>

  			</exclusion>

  			<exclusion> 

    			<groupId>log4j</groupId>

    			<artifactId>log4j</artifactId>

  			</exclusion>

  		</exclusions>

    </dependency>

    <dependency>

		<groupId>org.apache.zookeeper</groupId>

		<artifactId>zookeeper</artifactId>

		<version>3.4.6</version>

		<exclusions>

			<exclusion> 

    			<groupId>org.slf4j</groupId>

    			<artifactId>slf4j-log4j12</artifactId>

  			</exclusion>

  			<exclusion> 

    			<groupId>log4j</groupId>

    			<artifactId>log4j</artifactId>

  			</exclusion>

  		</exclusions>

	</dependency>

	<dependency>

		<groupId>org.apache.storm</groupId>

		<artifactId>storm-hdfs</artifactId>

		<version>0.10.0</version>

		<exclusions>

			<exclusion> 

    			<groupId>org.slf4j</groupId>

    			<artifactId>slf4j-log4j12</artifactId>

  			</exclusion>

  			<exclusion> 

    			<groupId>log4j</groupId>

    			<artifactId>log4j</artifactId>

  			</exclusion>

  		</exclusions>

	</dependency>

	<dependency>

		<groupId>org.apache.storm</groupId>

		<artifactId>storm-kafka</artifactId>

		<version>0.10.0</version>

		<exclusions>

			<exclusion> 

    			<groupId>org.slf4j</groupId>

    			<artifactId>slf4j-log4j12</artifactId>

  			</exclusion>

  			<exclusion> 

    			<groupId>log4j</groupId>

    			<artifactId>log4j</artifactId>

  			</exclusion>

  		</exclusions>

	</dependency>

	<dependency>

	<groupId>org.apache.kafka</groupId>

	<artifactId>kafka_2.10</artifactId>

	<version>0.8.2.2</version>

	<exclusions>

                <exclusion>

                    <groupId>org.apache.zookeeper</groupId>

                    <artifactId>zookeeper</artifactId>

                </exclusion>

                <exclusion>

                    <groupId>log4j</groupId>

                    <artifactId>log4j</artifactId>

                </exclusion>

            </exclusions>

	</dependency>

	<dependency>

		<groupId>org.apache.storm</groupId>

		<artifactId>storm-hbase</artifactId>

		<version>0.10.0</version>

		<exclusions>

			<exclusion> 

    			<groupId>org.slf4j</groupId>

    			<artifactId>slf4j-log4j12</artifactId>

  			</exclusion>

  			<exclusion> 

    			<groupId>log4j</groupId>

    			<artifactId>log4j</artifactId>

  			</exclusion>

  		</exclusions>

	</dependency>

    <dependency>

		<groupId>org.apache.hbase</groupId>

		<artifactId>hbase-client</artifactId>

		<version>1.1.1</version>

		<exclusions>

			<exclusion> 

    			<groupId>org.slf4j</groupId>

    			<artifactId>slf4j-log4j12</artifactId>

  			</exclusion>

  			<exclusion> 

    			<groupId>log4j</groupId>

    			<artifactId>log4j</artifactId>

  			</exclusion>

  		</exclusions>	

	</dependency>
</dependencies>