Support Questions

Find answers, ask questions, and share your expertise

Spark Streaming Twitter - Object twitter is not a member of org.apache.spark.streaming

avatar

I am using Sandbox with HDP 2.4 (Spark 1.6)

When I enter the following in spark-shell, I get the error.

import org.apache.spark.streaming.twitter._

Error Message:

Object twitter is not a member of org.apache.spark.streaming

1 ACCEPTED SOLUTION

avatar

It requires spark-streaming jar to be added.

Download the jar from here : https://mvnrepository.com/artifact/org.apache.spark/spark-streaming-twitter_2.10/1.0.0

Open spark shell using:

spark-shell --jars /path/to/jarFile

View solution in original post

1 REPLY 1

avatar

It requires spark-streaming jar to be added.

Download the jar from here : https://mvnrepository.com/artifact/org.apache.spark/spark-streaming-twitter_2.10/1.0.0

Open spark shell using:

spark-shell --jars /path/to/jarFile