Support Questions
Find answers, ask questions, and share your expertise

Spark application using scala IDE

Spark application using scala IDE

Explorer

I am creating my first application using Scala IDE. I got some errors.

I need to import the jars related to spark. can anyone suggest the jars

65003-12.png

1 REPLY 1

Re: Spark application using scala IDE

Expert Contributor

You need to add spark-core as dependency. It will download all required jar files.

You can refer code from https://github.com/databricks/learning-spark.

It has WordCount sample program. https://github.com/databricks/learning-spark/blob/master/mini-complete-example/src/main/scala/com/or...

Steps:

1. Clone of download repo from https://github.com/databricks/learning-spark

2. Extract the repo. Go to mini-complete-example directory.

3. Build the Project

mvn clean install

4. Import project into IDE and run WordCount.scala.

Thanks

Shubham