I'm trying to build a simple Spark Java application that pulls its dependencies from the HDP Releases repository. My project only depends on:
<dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-core_2.10</artifactId> <version>184.108.40.206.3.4.0-3485</version> <scope>provided</scope> </dependency>
Through a complex web of dependencies jetty-util version 6.1.26.hwx is required, but it is not found in any publicly visible repository. Where can I find this dependency so that I can build a Spark application that uses Hortonworks packaged jars? Is it best to exclude the jetty-util dependency from spark-core_2.10 and then explicitly add it to the project with a non-HWX version?
(This question is similar to https://community.hortonworks.com/questions/6256/j... but the solution posted there does not work for my scenario.)
Because that doesn't work as I'm not trying to build the hadoop-auth package. Setting '-Djetty.version=6.1.26' does nothing since that variable isn't used anywhere in my Spark application.
I was missing the extra HDP Jetty repo: