question Re: Spark Streaming Twitter - Object twitter is not a member of org.apache.spark.streaming in Archives of Support Questions (Read Only)

Spark Streaming Twitter - Object twitter is not a member of org.apache.spark.streaming

dineshc — Thu, 06 Jul 2017 00:57:31 GMT

I am using Sandbox with HDP 2.4 (Spark 1.6)

When I enter the following in spark-shell, I get the error.

import org.apache.spark.streaming.twitter._

Error Message:

Object twitter is not a member of org.apache.spark.streaming

dineshc — Thu, 06 Jul 2017 01:53:02 GMT

It requires spark-streaming jar to be added.

Open spark shell using:

spark-shell --jars /path/to/jarFile