Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Mapredice job failed to fetch the offset

Mapredice job failed to fetch the offset

Explorer

Sometimes one of my mapreduce jobs getting the following error, i'm interesting if it related the map reduce or to kafka.
The issue not happened with other kafka consumer map reduce jobs and it only happen with one of the job mappers.

 

 

 

2016-07-08 23:35:36,966 INFO [Thread-13] com.hadoop.platform.kafka.consumer.KafkaContext: fetching offset 23502569006841
2016-07-09 01:35:37,227 INFO [Thread-13] kafka.consumer.SimpleConsumer: Reconnect in fetch request due to socket error:
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at kafka.utils.Utils$.read(Utils.scala:538)
at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:67)
at kafka.network.Receive$class.readCompletely(Transmission.scala:55)
at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
at kafka.consumer.SimpleConsumer.getResponse(SimpleConsumer.scala:177)
at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:83)
at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:81)
at kafka.javaapi.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:43)
at com..hadoop.platform.kafka.consumer.KafkaContext$FetchThread.run(KafkaContext.java:215)
2016-07-09 01:35:37,247 INFO [Thread-13] com.hadoop.platform.kafka.consumer.KafkaContext: fetching in loop offset 23502570051501
 

1 REPLY 1
Highlighted

Re: Mapredice job failed to fetch the offset

Explorer

anyone who can help here?