- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Kafka spout cannot read from kafka topic
- Labels:
-
Apache Hive
-
Apache Kafka
-
Apache Storm
Created ‎02-10-2017 11:47 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hey guys, I'm pretty new to kafka and storm and I'm trying to run the kafka-storm-hive-integration project from git
https://github.com/DevelopersWithPassion/kafka-storm-hive-integration.
I packaged the project and run the storm jar command but I keep having this error :
s.k.PartitionManager - Read partition information from: /namenode:6667/id7/partition_1 --> null
No partition information found, using configuration to determine offset
this is the topology.properties:
zkhost = namenode:2181
inputTopic = inputtest
KafkaBroker = namenode:6667
consumerGroup= id7
metaStoreURI = thrift://namenode:9083
dbName = default
tblName = test
Really I don't know where to begin, can anyone guide me through this issue and I'll send further informations about the code ? thanks
Created ‎02-13-2017 10:45 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hey guys I found the error, :
when executing the storm jar command, we have to specify a topology name (whatever it is ) ex:
storm jar kafka-storm-integration-0.0.1-SNAPSHOT.jar com.storm.topology.KafkaTopology topology.properties testTopo
It wasn't specified in the readme.md. Any way thank you guys ^^
Created ‎02-10-2017 11:51 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Here is the example kafka spout code : https://github.com/rajkrrsingh/KafkaSpoutStorm
Created ‎02-10-2017 06:36 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Please make sure you have a Topic created in Kafka: https://kafka.apache.org/documentation/#quickstart_createtopic
Created ‎02-13-2017 08:02 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I've created it, I think there is a problem in the zkroot, I don't know how to configure it
Created ‎02-13-2017 10:45 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hey guys I found the error, :
when executing the storm jar command, we have to specify a topology name (whatever it is ) ex:
storm jar kafka-storm-integration-0.0.1-SNAPSHOT.jar com.storm.topology.KafkaTopology topology.properties testTopo
It wasn't specified in the readme.md. Any way thank you guys ^^
