Created 01-04-2016 08:10 PM
I'm trying to build a simple Spark Java application that pulls its dependencies from the HDP Releases repository. My project only depends on:
<dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-core_2.10</artifactId> <version>1.5.2.2.3.4.0-3485</version> <scope>provided</scope> </dependency>
Through a complex web of dependencies jetty-util version 6.1.26.hwx is required, but it is not found in any publicly visible repository. Where can I find this dependency so that I can build a Spark application that uses Hortonworks packaged jars? Is it best to exclude the jetty-util dependency from spark-core_2.10 and then explicitly add it to the project with a non-HWX version?
(This question is similar to https://community.hortonworks.com/questions/6256/j... but the solution posted there does not work for my scenario.)
Created 01-04-2016 11:34 PM
Created 01-04-2016 11:02 PM
@Vladimir Zlatkin why don't you build it using the solution from @stevel ?
Created 01-04-2016 11:10 PM
Because that doesn't work as I'm not trying to build the hadoop-auth package. Setting '-Djetty.version=6.1.26' does nothing since that variable isn't used anywhere in my Spark application.
Created 01-04-2016 11:34 PM
Created 01-05-2016 12:15 AM
That worked!
I was missing the extra HDP Jetty repo:
<url>http://repo.hortonworks.com/content/repositories/jetty-hadoop/</url>
Created 01-05-2016 02:21 AM
please accept the answer to close the thread.