Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

Kafka spout cannot read from kafka topic

Hey guys, I'm pretty new to kafka and storm and I'm trying to run the kafka-storm-hive-integration project from git

https://github.com/DevelopersWithPassion/kafka-storm-hive-integration.

I packaged the project and run the storm jar command but I keep having this error :

s.k.PartitionManager - Read partition information from: /namenode:6667/id7/partition_1 --> null

No partition information found, using configuration to determine offset

this is the topology.properties:

zkhost = namenode:2181

inputTopic = inputtest

KafkaBroker = namenode:6667

consumerGroup= id7

metaStoreURI = thrift://namenode:9083

dbName = default

tblName = test

Really I don't know where to begin, can anyone guide me through this issue and I'll send further informations about the code ? thanks

1 ACCEPTED SOLUTION

Hey guys I found the error, :

when executing the storm jar command, we have to specify a topology name (whatever it is ) ex:

storm jar kafka-storm-integration-0.0.1-SNAPSHOT.jar com.storm.topology.KafkaTopology topology.properties testTopo

It wasn't specified in the readme.md. Any way thank you guys ^^

View solution in original post

4 REPLIES 4

@Seyma Menjour

Here is the example kafka spout code : https://github.com/rajkrrsingh/KafkaSpoutStorm

Rising Star

Please make sure you have a Topic created in Kafka: https://kafka.apache.org/documentation/#quickstart_createtopic

I've created it, I think there is a problem in the zkroot, I don't know how to configure it

Hey guys I found the error, :

when executing the storm jar command, we have to specify a topology name (whatever it is ) ex:

storm jar kafka-storm-integration-0.0.1-SNAPSHOT.jar com.storm.topology.KafkaTopology topology.properties testTopo

It wasn't specified in the readme.md. Any way thank you guys ^^