Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

Spark application using scala IDE

Explorer

I am creating my first application using Scala IDE. I got some errors.

I need to import the jars related to spark. can anyone suggest the jars

65003-12.png

1 REPLY 1

Expert Contributor

You need to add spark-core as dependency. It will download all required jar files.

You can refer code from https://github.com/databricks/learning-spark.

It has WordCount sample program. https://github.com/databricks/learning-spark/blob/master/mini-complete-example/src/main/scala/com/or...

Steps:

1. Clone of download repo from https://github.com/databricks/learning-spark

2. Extract the repo. Go to mini-complete-example directory.

3. Build the Project

mvn clean install

4. Import project into IDE and run WordCount.scala.

Thanks

Shubham