Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to enable TwitterUtils Spark Streaming on CDH 5.2

Highlighted

How to enable TwitterUtils Spark Streaming on CDH 5.2

Rising Star

Hello,

 

I successfully installed the CDH 5.2 cluster. I can also start the spark-shell on my machines.

 

I can also import the streaming context in the spark-shell

 

scala> import org.apache.spark.streaming._
import org.apache.spark.streaming._

scala> import org.apache.spark.streaming.StreamingContext._
import org.apache.spark.streaming.StreamingContext._

 

but when I try to do a 

 

import org.apache.spark.streaming.twitter._

 

I get error

<console>:16: error: object twitter is not a member of package org.apache.spark.streaming

import org.apache.spark.streaming.twitter._

 

How can I write a twitter streaming application inside the spark-shell?

Don't have an account?
Coming from Hortonworks? Activate your account here