Cloudera Community

Welcome to the Cloudera Community

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

run-example streaming.KafkaWordCount fails on CDH 5.7.0

avatar
author-rank jimneustads
Explorer

Created ‎05-04-2016 02:17 AM

 

Hi,

 

After an upgrade to CDH 5.7.0 we have troubles with the Kafka to Spark Streaming.

We're running Kafka 0.8.2.2

 

The example jar doesn’t work:

 

/opt/cloudera/parcels/CDH/lib/spark/bin/run-example streaming.KafkaWordCount ….

 

Attached is a log file.

 

16/05/04 10:06:23 WARN consumer.ConsumerFetcherThread: [ConsumerFetcherThread-wordcount1_host81436-cld.domain.com-1462349182172-13b9f2e7-0-2], Error in fetch kafka.consumer.ConsumerFetcherThread$FetchRequest@47fb7e6d. Possible cause: java.nio.BufferUnderflowException

16/05/04 10:06:24 WARN consumer.ConsumerFetcherThread: [ConsumerFetcherThread-wordcount1_host81436-cld.domain.com-1462349182172-13b9f2e7-0-1], Error in fetch kafka.consumer.ConsumerFetcherThread$FetchRequest@73b9a762. Possible cause: java.lang.IllegalArgumentException

 

We have no problem running this from my development pc, only in product op CDH 5.7.0 environment.

 

 

Any ideas?

 

Thanks,

Michel

4,596
0 Kudos
1
Who agreed with this topic