I am using Sandbox with HDP 2.4 (Spark 1.6)
When I enter the following in spark-shell, I get the error.
Object twitter is not a member of org.apache.spark.streaming
It requires spark-streaming jar to be added.
Download the jar from here : https://mvnrepository.com/artifact/org.apache.spark/spark-streaming-twitter_2.10/1.0.0
Open spark shell using:
spark-shell --jars /path/to/jarFile
View solution in original post