Support Questions

Find answers, ask questions, and share your expertise

How to create jar file from spark scala file?


Rising Star

I think that the best option for compiling scala Spark code is to use sbt,which is a tool for managing dependencies. You can do the same with Maven anyway, as you prefer.

See "Self-Contained Applications" for all languages


Though there are many ways to do that but you can use sbt tool to build your application jar, below is a good example doc to build a jar and run it on spark

In case you are looking for a Maven project to build Spark/Scala. Here is an example

Note it was for Spark 1.1.0 but you can change the version.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.