Created 07-05-2017 05:57 PM
I am using Sandbox with HDP 2.4 (Spark 1.6)
When I enter the following in spark-shell, I get the error.
import org.apache.spark.streaming.twitter._
Error Message:
Object twitter is not a member of org.apache.spark.streaming
Created 07-05-2017 06:53 PM
It requires spark-streaming jar to be added.
Download the jar from here : https://mvnrepository.com/artifact/org.apache.spark/spark-streaming-twitter_2.10/1.0.0
Open spark shell using:
spark-shell --jars /path/to/jarFile
View solution in original post