question Re: Spark Streaming Kafka dependency issue on Zeppelin in Archives of Support Questions (Read Only)

Spark Streaming Kafka dependency issue on Zeppelin

mahan — Thu, 28 Jan 2016 08:48:44 GMT

Anyone has any idea why I get the following error when I execute KafkaUtils.createStream on Zeppelin? However it works fine on spark-shell yarn-client

error: bad symbolic reference. A signature in KafkaUtils.class refers to term kafka
in package <root> which is not available.
It may be completely missing from the current classpath, or the version on
the classpath might be incompatible with the version used when compiling KafkaUtils.class.
error: bad symbolic reference. A signature in KafkaUtils.class refers to term serializer
in value kafka which is not available.
It may be completely missing from the current classpath, or the version on
the classpath might be incompatible with the version used when compiling KafkaUtils.class.

Re: Spark Streaming Kafka dependency issue on Zeppelin

nsabharwal — Sun, 31 Jan 2016 20:46:57 GMT

@Mahan Hosseinzadeh

Zeppelin works with spark streaming but I don't think Kafka is supported yet. I see no reference of kafka in git code ..link

Re: Spark Streaming Kafka dependency issue on Zeppelin

aervits — Tue, 02 Feb 2016 10:27:25 GMT

@Mahan Hosseinzadeh are you still having issues with this? Can you accept the best answer or provide your own solution?

Re: Spark Streaming Kafka dependency issue on Zeppelin

mahan — Wed, 03 Feb 2016 02:24:17 GMT

I see no sign of Kafka on Zeppelin, but apparently TwitterUtils is available to use!

Re: Spark Streaming Kafka dependency issue on Zeppelin

maryrogers1107 — Tue, 29 Mar 2016 23:08:34 GMT

@Mahan Hosseinzadah Are you using 0.8.2.2 version of Kafka. I believe I was getting that error when I used another version.

Re: Spark Streaming Kafka dependency issue on Zeppelin

sharathmk99 — Sat, 17 Sep 2016 00:58:46 GMT

@Mahan Hosseinzadeh Did you resolve the issue???

@Mahan Hosseinzadah Did you resolve the issue??

Re: Spark Streaming Kafka dependency issue on Zeppelin

sharathmk99 — Sat, 17 Sep 2016 01:01:17 GMT

@Neeraj Sabharwal Is kafka is supported in Zeppelin on HDP.

I have used Kafka with zeppelin with standalone Spark installation.

But not working with HDP.