Created 02-10-2017 11:47 AM
Hey guys, I'm pretty new to kafka and storm and I'm trying to run the kafka-storm-hive-integration project from git
https://github.com/DevelopersWithPassion/kafka-storm-hive-integration.
I packaged the project and run the storm jar command but I keep having this error :
s.k.PartitionManager - Read partition information from: /namenode:6667/id7/partition_1 --> null
No partition information found, using configuration to determine offset
this is the topology.properties:
zkhost = namenode:2181
inputTopic = inputtest
KafkaBroker = namenode:6667
consumerGroup= id7
metaStoreURI = thrift://namenode:9083
dbName = default
tblName = test
Really I don't know where to begin, can anyone guide me through this issue and I'll send further informations about the code ? thanks
Created 02-13-2017 10:45 AM
Hey guys I found the error, :
when executing the storm jar command, we have to specify a topology name (whatever it is ) ex:
storm jar kafka-storm-integration-0.0.1-SNAPSHOT.jar com.storm.topology.KafkaTopology topology.properties testTopo
It wasn't specified in the readme.md. Any way thank you guys ^^
Created 02-10-2017 11:51 AM
Here is the example kafka spout code : https://github.com/rajkrrsingh/KafkaSpoutStorm
Created 02-10-2017 06:36 PM
Please make sure you have a Topic created in Kafka: https://kafka.apache.org/documentation/#quickstart_createtopic
Created 02-13-2017 08:02 AM
I've created it, I think there is a problem in the zkroot, I don't know how to configure it
Created 02-13-2017 10:45 AM
Hey guys I found the error, :
when executing the storm jar command, we have to specify a topology name (whatever it is ) ex:
storm jar kafka-storm-integration-0.0.1-SNAPSHOT.jar com.storm.topology.KafkaTopology topology.properties testTopo
It wasn't specified in the readme.md. Any way thank you guys ^^