kafkaspout is failing with NoSuchMethodError, does anybody know what could cause this issue.

akkran23 — Wed, 14 Dec 2016 15:34:25 GMT

[Thread-13-kafka-spout-executor[6 6]] ERROR o.a.s.util - Async loop died! java.lang.NoSuchMethodError: org.apache.kafka.common.network.NetworkSend.<init>(Ljava/lang/String;[Ljava/nio/ByteBuffer;)V at kafka.network.RequestOrResponseSend.<init>(RequestOrResponseSend.scala:41) ~[kafka_2.11-0.10.0.0.jar:?] at kafka.network.RequestOrResponseSend.<init>(RequestOrResponseSend.scala:44) ~[kafka_2.11-0.10.0.0.jar:?] at kafka.network.BlockingChannel.send(BlockingChannel.scala:112) ~[kafka_2.11-0.10.0.0.jar:?] at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:98) ~[kafka_2.11-0.10.0.0.jar:?] at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:83) ~[kafka_2.11-0.10.0.0.jar:?] at kafka.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:149) ~[kafka_2.11-0.10.0.0.jar:?] at kafka.javaapi.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:79) ~[kafka_2.11-0.10.0.0.jar:?] at org.apache.storm.kafka.KafkaUtils.getOffset(KafkaUtils.java:75) ~[storm-kafka-1.0.2.jar:1.0.2] at org.apache.storm.kafka.KafkaUtils.getOffset(KafkaUtils.java:65) ~[storm-kafka-1.0.2.jar:1.0.2] at org.apache.storm.kafka.PartitionManager.<init>(PartitionManager.java:103) ~[storm-kafka-1.0.2.jar:1.0.2] at org.apache.storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:98) ~[storm-kafka-1.0.2.jar:1.0.2] at org.apache.storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:69) ~[storm-kafka-1.0.2.jar:1.0.2] at org.apache.storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:129) ~[storm-kafka-1.0.2.jar:1.0.2] at org.apache.storm.daemon.executor$fn__7990$fn__8005$fn__8036.invoke(executor.clj:648) ~[storm-core-1.0.2.jar:1.0.2] at org.apache.storm.util$async_loop$fn__624.invoke(util.clj:484) [storm-core-1.0.2.jar:1.0.2] at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]

Re: kafkaspout is failing with NoSuchMethodError, does anybody know what could cause this issue.

sandyy006 — Wed, 14 Dec 2016 15:40:27 GMT

@akshay singh

Can you confirm if the HDP version and the dependencies version in your pom.xml are same ?

Take a look at https://community.hortonworks.com/articles/27999/a-maven-pomxml-for-building-storm-topologies.html

Re: kafkaspout is failing with NoSuchMethodError, does anybody know what could cause this issue.

rajkumar_singh — Wed, 14 Dec 2016 15:43:25 GMT

it looks you are using apache dependencies not the hortonworks could you please add the hw dependencies http://nexus-private.hortonworks.com/nexus/content/groups/public/,

specially the kafka client library, before Kafka 0.9, NetworkSend constructor has Integer as first argument instead of string, in kafka-1928 it was changed

question Re: kafkaspout is failing with NoSuchMethodError, does anybody know what could cause this issue. in Archives of Support Questions (Read Only)

kafkaspout is failing with NoSuchMethodError, does anybody know what could cause this issue.

Re: kafkaspout is failing with NoSuchMethodError, does anybody know what could cause this issue.

Re: kafkaspout is failing with NoSuchMethodError, does anybody know what could cause this issue.