- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Is there a Spark Maven archetype for Java?
- Labels:
-
Apache Spark
Created ‎01-03-2016 07:06 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Is there a Maven Archetype that does the following?
- Setup HDP Maven repository
- Create Maven profiles to download different versions of Spark and Hadoop jars based on HDP version
- Setup for building an uber jar
- Add a sample Java application and test case to the project
- Add winutils binaries to run test-cases on Windows
I found this: https://github.com/spark-in-action/scala-archetype-sparkinaction, which does #4, but for Scala.
Created ‎02-02-2016 03:00 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I created a simple archetype to solve 1-4. It can be found at the link below.
Created ‎01-29-2016 08:40 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Unfortunately, I have not found any archetype to meet these requirements, but the need is there.
The project below seems to meet #4 on the list as a starting point:
Created ‎02-01-2016 05:30 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Vladimir Zlatkin that would be awesome if we had and HDP Maven archetype. Following the issue in case we find a custom archetype.
Created ‎02-02-2016 03:00 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I created a simple archetype to solve 1-4. It can be found at the link below.
