Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

kafkaspout is failing with NoSuchMethodError, does anybody know what could cause this issue.

Solved Go to solution
Highlighted

kafkaspout is failing with NoSuchMethodError, does anybody know what could cause this issue.

Explorer

[Thread-13-kafka-spout-executor[6 6]] ERROR o.a.s.util - Async loop died! java.lang.NoSuchMethodError: org.apache.kafka.common.network.NetworkSend.<init>(Ljava/lang/String;[Ljava/nio/ByteBuffer;)V at kafka.network.RequestOrResponseSend.<init>(RequestOrResponseSend.scala:41) ~[kafka_2.11-0.10.0.0.jar:?] at kafka.network.RequestOrResponseSend.<init>(RequestOrResponseSend.scala:44) ~[kafka_2.11-0.10.0.0.jar:?] at kafka.network.BlockingChannel.send(BlockingChannel.scala:112) ~[kafka_2.11-0.10.0.0.jar:?] at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:98) ~[kafka_2.11-0.10.0.0.jar:?] at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:83) ~[kafka_2.11-0.10.0.0.jar:?] at kafka.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:149) ~[kafka_2.11-0.10.0.0.jar:?] at kafka.javaapi.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:79) ~[kafka_2.11-0.10.0.0.jar:?] at org.apache.storm.kafka.KafkaUtils.getOffset(KafkaUtils.java:75) ~[storm-kafka-1.0.2.jar:1.0.2] at org.apache.storm.kafka.KafkaUtils.getOffset(KafkaUtils.java:65) ~[storm-kafka-1.0.2.jar:1.0.2] at org.apache.storm.kafka.PartitionManager.<init>(PartitionManager.java:103) ~[storm-kafka-1.0.2.jar:1.0.2] at org.apache.storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:98) ~[storm-kafka-1.0.2.jar:1.0.2] at org.apache.storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:69) ~[storm-kafka-1.0.2.jar:1.0.2] at org.apache.storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:129) ~[storm-kafka-1.0.2.jar:1.0.2] at org.apache.storm.daemon.executor$fn__7990$fn__8005$fn__8036.invoke(executor.clj:648) ~[storm-core-1.0.2.jar:1.0.2] at org.apache.storm.util$async_loop$fn__624.invoke(util.clj:484) [storm-core-1.0.2.jar:1.0.2] at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: kafkaspout is failing with NoSuchMethodError, does anybody know what could cause this issue.

it looks you are using apache dependencies not the hortonworks could you please add the hw dependencies http://nexus-private.hortonworks.com/nexus/content/groups/public/,

specially the kafka client library, before Kafka 0.9, NetworkSend constructor has Integer as first argument instead of string, in kafka-1928 it was changed

View solution in original post

2 REPLIES 2
Highlighted

Re: kafkaspout is failing with NoSuchMethodError, does anybody know what could cause this issue.

@akshay singh

Can you confirm if the HDP version and the dependencies version in your pom.xml are same ?

Take a look at https://community.hortonworks.com/articles/27999/a-maven-pomxml-for-building-storm-topologies.html

Highlighted

Re: kafkaspout is failing with NoSuchMethodError, does anybody know what could cause this issue.

it looks you are using apache dependencies not the hortonworks could you please add the hw dependencies http://nexus-private.hortonworks.com/nexus/content/groups/public/,

specially the kafka client library, before Kafka 0.9, NetworkSend constructor has Integer as first argument instead of string, in kafka-1928 it was changed

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here