Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Spark Streaming Twitter - Object twitter is not a member of org.apache.spark.streaming

avatar

I am using Sandbox with HDP 2.4 (Spark 1.6)

When I enter the following in spark-shell, I get the error.

import org.apache.spark.streaming.twitter._

Error Message:

Object twitter is not a member of org.apache.spark.streaming

1 ACCEPTED SOLUTION

avatar

It requires spark-streaming jar to be added.

Download the jar from here : https://mvnrepository.com/artifact/org.apache.spark/spark-streaming-twitter_2.10/1.0.0

Open spark shell using:

spark-shell --jars /path/to/jarFile

View solution in original post

1 REPLY 1

avatar

It requires spark-streaming jar to be added.

Download the jar from here : https://mvnrepository.com/artifact/org.apache.spark/spark-streaming-twitter_2.10/1.0.0

Open spark shell using:

spark-shell --jars /path/to/jarFile