Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

how to download dependencies for spark-stream-twitter

how to download dependencies for spark-stream-twitter

Explorer

I have the following in build.sbt

 

scalaVersion := "2.10.3"

 

libraryDependencies ++= Seq(

  "org.apache.spark" %% "spark-streaming-twitter" % "0.9.0-cdh5.0.1",

  "org.twitter4j" % "twitter4j-core" % "3.0.3")

 

resolvers ++= Seq(

  "Akka Repository" at "http://repo.akka.io/releases/",

  "Twitter4j" at "http://twitter4j.org/maven2/",

  "Spark RC5" at "https://repository.cloudera.com/artifactory/repo/org/apache/spark/spark-streaming-twitter_2.10/0.9.0...

  "Spray Repository" at "http://repo.spray.cc/")

 

it can not resolve spark-streaming-twitter.

sbt.ResolveException: unresolved dependency: org.apache.spark#spark-streaming-twitter_2.10;0.9.0-cdh5.0.1: not found

 

I am new to scala and sbt. did I do something wrong?

1 REPLY 1

Re: how to download dependencies for spark-stream-twitter

Master Collaborator

I believe the CDH5 repo needs to just be https://repository.cloudera.com/artifactory/repo/ since it will resolve org/apache/... relative to that.

Don't have an account?
Coming from Hortonworks? Activate your account here