Support Questions

Find answers, ask questions, and share your expertise

Need to explore Spark & Scala programs and examples

Explorer

Can somebody guide me with Spark+ Scala complete examples? Is there any documents or online link or any book where I can see some complete examples of Spark + Scala

2 REPLIES 2

@Hardik Dave Probably the three best resources are going to be the Apache Spark Programming Guide [1], which lays out a lot examples that can run in spark-shell or a Zeppelin notebook in Scala, Python or Java, the HDP Spark Tutorial [2], and the example programs on GitHub [3]. The example programs all include a main method that illustrates how you'd set things up for a batch job. Last thing, you might want to check out sbt-native-packager [4] or sbt-assembly [5] which are useful for packaging Scala apps into fat jars.

  1. https://spark.apache.org/docs/latest/rdd-programming-guide.html
  2. https://hortonworks.com/tutorial/hands-on-tour-of-apache-spark-in-5-minutes/
  3. https://github.com/apache/spark/tree/master/examples/src/main/scala/org/apache/spark/examples
  4. https://github.com/sbt/sbt-native-packager
  5. https://github.com/sbt/sbt-assembly/

Explorer

@jfrazee Thank you very much. It will help me a lot to explore Spark & Scala. Thanks for guidance.