Support Questions

Find answers, ask questions, and share your expertise

Kafka spout cannot read from kafka topic

avatar

Hey guys, I'm pretty new to kafka and storm and I'm trying to run the kafka-storm-hive-integration project from git

https://github.com/DevelopersWithPassion/kafka-storm-hive-integration.

I packaged the project and run the storm jar command but I keep having this error :

s.k.PartitionManager - Read partition information from: /namenode:6667/id7/partition_1 --> null

No partition information found, using configuration to determine offset

this is the topology.properties:

zkhost = namenode:2181

inputTopic = inputtest

KafkaBroker = namenode:6667

consumerGroup= id7

metaStoreURI = thrift://namenode:9083

dbName = default

tblName = test

Really I don't know where to begin, can anyone guide me through this issue and I'll send further informations about the code ? thanks

1 ACCEPTED SOLUTION

avatar

Hey guys I found the error, :

when executing the storm jar command, we have to specify a topology name (whatever it is ) ex:

storm jar kafka-storm-integration-0.0.1-SNAPSHOT.jar com.storm.topology.KafkaTopology topology.properties testTopo

It wasn't specified in the readme.md. Any way thank you guys ^^

View solution in original post

4 REPLIES 4

avatar
@Seyma Menjour

Here is the example kafka spout code : https://github.com/rajkrrsingh/KafkaSpoutStorm

avatar
Expert Contributor

Please make sure you have a Topic created in Kafka: https://kafka.apache.org/documentation/#quickstart_createtopic

avatar

I've created it, I think there is a problem in the zkroot, I don't know how to configure it

avatar

Hey guys I found the error, :

when executing the storm jar command, we have to specify a topology name (whatever it is ) ex:

storm jar kafka-storm-integration-0.0.1-SNAPSHOT.jar com.storm.topology.KafkaTopology topology.properties testTopo

It wasn't specified in the readme.md. Any way thank you guys ^^