Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Need to explore Spark & Scala programs and examples

Highlighted

Need to explore Spark & Scala programs and examples

Explorer

Can somebody guide me with Spark+ Scala complete examples? Is there any documents or online link or any book where I can see some complete examples of Spark + Scala

2 REPLIES 2
Highlighted

Re: Need to explore Spark & Scala programs and examples

@Hardik Dave Probably the three best resources are going to be the Apache Spark Programming Guide [1], which lays out a lot examples that can run in spark-shell or a Zeppelin notebook in Scala, Python or Java, the HDP Spark Tutorial [2], and the example programs on GitHub [3]. The example programs all include a main method that illustrates how you'd set things up for a batch job. Last thing, you might want to check out sbt-native-packager [4] or sbt-assembly [5] which are useful for packaging Scala apps into fat jars.

  1. https://spark.apache.org/docs/latest/rdd-programming-guide.html
  2. https://hortonworks.com/tutorial/hands-on-tour-of-apache-spark-in-5-minutes/
  3. https://github.com/apache/spark/tree/master/examples/src/main/scala/org/apache/spark/examples
  4. https://github.com/sbt/sbt-native-packager
  5. https://github.com/sbt/sbt-assembly/

Re: Need to explore Spark & Scala programs and examples

Explorer

@jfrazee Thank you very much. It will help me a lot to explore Spark & Scala. Thanks for guidance.

Don't have an account?
Coming from Hortonworks? Activate your account here