jetty-util-6.1.26.hwx.jar

[#1]

How does one build Hadoop Auth 2.7.1-SNAPSHOT? As near as I can tell, jetty-util-6.1.26.hwx is unavailable.

I notice that somebody else had a similar problem, but it hasn't helped me:

http://mail-archives.apache.org/mod_mbox/incubator-flink-issues/201509.mbox/%3Cgit-pr-1113-flink@git...

Following are the build errors:
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Auth 2.7.1-SNAPSHOT
[INFO] ------------------------------------------------------------------------
Downloading: https://repository.apache.org/content/repositories/snapshots/org/mortbay/jetty/jetty-util/6.1.26.hwx...Downloading: http://repository.jboss.org/nexus/content/groups/public/org/mortbay/jetty/jetty-util/6.1.26.hwx/jett...Downloading: https://repo.maven.apache.org/maven2/org/mortbay/jetty/jetty-util/6.1.26.hwx/jetty-util-6.1.26.hwx.p...[WARNING] The POM for org.mortbay.jetty:jetty-util:jar:6.1.26.hwx is missing, no dependency information available
[WARNING] The POM for org.mortbay.jetty:jetty:jar:6.1.26.hwx is missing, no dependency information available
Downloading: https://repository.apache.org/content/repositories/snapshots/org/mortbay/jetty/jetty-util/6.1.26.hwx...Downloading: http://repository.jboss.org/nexus/content/groups/public/org/mortbay/jetty/jetty-util/6.1.26.hwx/jett...Downloading: https://repo.maven.apache.org/maven2/org/mortbay/jetty/jetty-util/6.1.26.hwx/jetty-util-6.1.26.hwx.j...[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop Main ................................. SUCCESS [  0.941 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [  0.677 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [  1.440 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [  0.094 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [  1.603 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [  1.539 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [  1.173 s]
[INFO] Apache Hadoop Auth ................................. FAILURE [ 21.470 s]
[INFO] Apache Hadoop Auth Examples ........................ SKIPPED
[INFO] Apache Hadoop Common ............................... SKIPPED
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED

[#2 · Accepted solution]

the .hwx version is one which has a security fix in; no other bug; it's not published to the maven central repo so not easy to pick up. We do have a repo which has it, but I think it's some internal one whose URLs don't resolve.

you can build with the normal one just by going -Djetty.version=6.1.26

[#3]

Thanks. For others, please ignore my next post. stevel solved it for me.

[#4]

Greetings,

I'm still struggling with this. In my effort to start out concise, I'm not sure I gave enough detail. I believe I've encountered a wider issue with the "hwx" version of jetty-utils.

I downloaded the HDP installer for Windows and got it up and running. I would now like to build the source included with the HDP installer. The zip bundle has hdp-2.3.0.0.winpkg.msi and 2.3.0.0.sources.zip. I installed the msi and configured Hadoop with few difficulties. I would now like to build the source. I have built a few different versions of Hadoop with success, but not this particular one.

As I mentioned above, this one particular version of jetty-utils appears to be missing from all the repositories. Here is what another person had to say (http://mail-archives.apache.org/mod_mbox/incubator-flink-issues/201509.mbox/%3Cgit-pr-1113-flink@git...😞 "Certain HDP-specific Hadoop releases depend on ``` [INFO] | +- org.mortbay.jetty:jetty:jar:6.1.26.hwx:compile [INFO] | +- org.mortbay.jetty:jetty-util:jar:6.1.26.hwx:compile ``` Which is only available in a special Hortonworks repository...Usually, we exclude jetty and other libraries which are only needed for Hadoop's web interfaces...This change does not affect the regular builds, because the additional repository is "hidden" by the maven build profile."

It seems from that post that the problems I'm encountering with this odd "hwx" version are a little deeper than permissions or maven configuration. Any help would be greatly appreciated.

Following is a more complete listing of the build log: [WARNING] Javadoc Warnings [WARNING] C:\Users\walkadmin.SRV\.m2\repository\org\apache\directory\api\api-ldap-model\1.0.0-M20\api-ldap-model-1.0.0-M20.jar(org/apache/directory/api/ldap/model/name/Dn.class): warning: Cannot find annotation method 'value()' in type 'SuppressWarnings': class file for edu.umd.cs.findbugs.annotations.SuppressWarnings not found [WARNING] C:\Users\walkadmin.SRV\.m2\repository\org\apache\directory\api\api-ldap-model\1.0.0-M20\api-ldap-model-1.0.0-M20.jar(org/apache/directory/api/ldap/model/name/Dn.class): warning: Cannot find annotation method 'justification()' in type 'SuppressWarnings' [INFO] Building jar: E:\Cus\bld\h2557\src.1\hadoop-2.7.1.2.3.0.0-2557\hadoop-common-project\hadoop-minikdc\target\hadoop-minikdc-2.7.1-SNAPSHOT-javadoc.jar [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop Auth 2.7.1-SNAPSHOT [INFO] ------------------------------------------------------------------------ Downloading: https://repository.apache.org/content/repositories/snapshots/org/mortbay/jetty/jetty/6.1.26.hwx/jett...

Downloading: http://repository.jboss.org/nexus/content/groups/public/org/mortbay/jetty/jetty/6.1.26.hwx/jetty-6.1...

Downloading: https://repo.maven.apache.org/maven2/org/mortbay/jetty/jetty/6.1.26.hwx/jetty-6.1.26.hwx.pom

[WARNING] The POM for org.mortbay.jetty:jetty:jar:6.1.26.hwx is missing, no dependency information available Downloading: https://repository.apache.org/content/repositories/snapshots/org/mortbay/jetty/jetty/6.1.26.hwx/jett...

Downloading: http://repository.jboss.org/nexus/content/groups/public/org/mortbay/jetty/jetty/6.1.26.hwx/jetty-6.1...

Downloading: https://repo.maven.apache.org/maven2/org/mortbay/jetty/jetty/6.1.26.hwx/jetty-6.1.26.hwx.jar

[INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop Main ................................. SUCCESS [ 12.872 s] [INFO] Apache Hadoop Project POM .......................... SUCCESS [ 0.641 s] [INFO] Apache Hadoop Annotations .......................... SUCCESS [ 1.601 s] [INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.097 s] [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 1.960 s] [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 1.445 s] [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 1.159 s] [INFO] Apache Hadoop Auth ................................. FAILURE [ 17.711 s] [INFO] Apache Hadoop Auth Examples ........................ SKIPPED [INFO] Apache Hadoop Common ............................... SKIPPED [INFO] Apache Hadoop NFS .................................. SKIPPED [INFO] Apache Hadoop KMS .................................. SKIPPED [INFO] Apache Hadoop Common Project ....................... SKIPPED [INFO] Apache Hadoop HDFS ................................. SKIPPED [INFO] Apache Hadoop HttpFS ............................... SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED [INFO] Apache Hadoop HDFS Project ......................... SKIPPED [INFO] hadoop-yarn ........................................ SKIPPED [INFO] hadoop-yarn-api .................................... SKIPPED [INFO] hadoop-yarn-common ................................. SKIPPED [INFO] hadoop-yarn-registry ............................... SKIPPED [INFO] hadoop-yarn-server ................................. SKIPPED [INFO] hadoop-yarn-server-common .......................... SKIPPED [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED [INFO] hadoop-yarn-server-tests ........................... SKIPPED [INFO] hadoop-yarn-client ................................. SKIPPED [INFO] hadoop-yarn-server-sharedcachemanager .............. SKIPPED [INFO] hadoop-yarn-applications ........................... SKIPPED [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED [INFO] hadoop-yarn-site ................................... SKIPPED [INFO] hadoop-yarn-project ................................ SKIPPED [INFO] hadoop-mapreduce-client ............................ SKIPPED [INFO] hadoop-mapreduce-client-core ....................... SKIPPED [INFO] hadoop-mapreduce-client-common ..................... SKIPPED [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED [INFO] hadoop-mapreduce-client-app ........................ SKIPPED [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED [INFO] hadoop-mapreduce ................................... SKIPPED [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED [INFO] Apache Hadoop Archives ............................. SKIPPED [INFO] Apache Hadoop Rumen ................................ SKIPPED [INFO] Apache Hadoop Gridmix .............................. SKIPPED [INFO] Apache Hadoop Data Join ............................ SKIPPED [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED [INFO] Apache Hadoop Extras ............................... SKIPPED [INFO] Apache Hadoop Pipes ................................ SKIPPED [INFO] Apache Hadoop OpenStack support .................... SKIPPED [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED [INFO] Apache Hadoop Azure support ........................ SKIPPED [INFO] Apache Hadoop Client ............................... SKIPPED [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED [INFO] Apache Hadoop Tools Dist ........................... SKIPPED [INFO] Apache Hadoop Tools ................................ SKIPPED [INFO] Apache Hadoop Distribution ......................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 39.091 s [INFO] Finished at: 2015-12-13T21:22:51-06:00 [INFO] Final Memory: 78M/720M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal on project hadoop-auth: Could not resolve dependencies for project org.apache.hadoop:hadoop-auth:jar:2.7.1-SNAPSHOT: Could not find artifact org.mortbay.jetty:jetty:jar:6.1.26.hwx in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal on project hadoop-auth: Could not resolve dependencies for project org.apache.hadoop:hadoop-auth:jar:2.7.1-SNAPSHOT: Could not find artifact org.mortbay.jetty:jetty:jar:6.1.26.hwx in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:221) at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies(LifecycleDependencyResolver.java:127) at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved(MojoExecutor.java:245) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:199) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288) at org.apache.maven.cli.MavenCli.main(MavenCli.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) Caused by: org.apache.maven.project.DependencyResolutionException: Could not resolve dependencies for project org.apache.hadoop:hadoop-auth:jar:2.7.1-SNAPSHOT: Could not find artifact org.mortbay.jetty:jetty:jar:6.1.26.hwx in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:211) at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:195) ... 23 more Caused by: org.eclipse.aether.resolution.DependencyResolutionException: Could not find artifact org.mortbay.jetty:jetty:jar:6.1.26.hwx in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:384) at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:205) ... 24 more Caused by: org.eclipse.aether.resolution.ArtifactResolutionException: Could not find artifact org.mortbay.jetty:jetty:jar:6.1.26.hwx in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:444) at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:246) at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:367) ... 25 more Caused by: org.eclipse.aether.transfer.ArtifactNotFoundException: Could not find artifact org.mortbay.jetty:jetty:jar:6.1.26.hwx in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) at org.eclipse.aether.connector.basic.ArtifactTransportListener.transferFailed(ArtifactTransportListener.java:39) at org.eclipse.aether.connector.basic.BasicRepositoryConnector$TaskRunner.run(BasicRepositoryConnector.java:355) at org.eclipse.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:67) at org.eclipse.aether.connector.basic.BasicRepositoryConnector$DirectExecutor.execute(BasicRepositoryConnector.java:581) at org.eclipse.aether.connector.basic.BasicRepositoryConnector.get(BasicRepositoryConnector.java:249) at org.eclipse.aether.internal.impl.DefaultArtifactResolver.performDownloads(DefaultArtifactResolver.java:520) at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:421) ... 27 more [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-auth

[#5]

Please ignore this post. stevel's post above solved the problem. It wasn't available with this second post.

[#6]

What repo URL are you using? Try using http://repo.hortonworks.com/content/groups/public

[#7]

How to use "http://repo.hortonworks.com/content/groups/public" during "mvn install"?

My error message is:

[ERROR] Failed to execute goal on project hadoop-auth: Could not resolve dependencies for project org.apache.hadoop:hadoop-auth:jar:2.6.0.2.2.4.2-2: The following artifacts could not be resolved: org.mortbay.jetty:jetty-util:jar:6.1.26.hwx, org.mortbay.jetty:jetty:jar:6.1.26.hwx, org.apache.zookeeper:zookeeper:jar:3.4.6.2.2.4.2-2: Failure to find org.mortbay.jetty:jetty-util:jar:6.1.26.hwx in https://repository.apache.org/content/repositories/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache.snapshots.https has elapsed or updates are forced -> [Help 1]

[#8]

I found the following property in the pom.xml of the top folder and changed it.

<properties> <distMgmtSnapshotsId>apache.snapshots.https</distMgmtSnapshotsId> <distMgmtSnapshotsName>Apache Development Snapshot Repository</distMgmtSnapshotsName> <distMgmtSnapshotsUrl>http://repo.hortonworks.com/content/groups/public/</distMgmtSnapshotsUrl> <distMgmtStagingId>apache.staging.https</distMgmtStagingId> <distMgmtStagingName>Apache Release Distribution Repository</distMgmtStagingName> <distMgmtStagingUrl>https://repository.apache.org/service/local/staging/deploy/maven2</distMgmtStagingUrl> <!-- platform encoding override --> <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding> <project.reporting.outputEncoding>UTF-8</project.reporting.outputEncoding> </properties>

After I changed it, the error is gone; however, another error:

[ERROR] Failed to execute goal org.apache.hadoop:hadoop-maven-plugins:2.6.0.2.2.4.2-2:protoc (compile-protoc) on project hadoop-common: org.apache.maven.plugin.MojoExecutionException: 'protoc --version' did not return a version -> [Help 1]

I guess it is another learning adventure...

[#9]

Finally, I got it.

This is what I’ve done to compile (mvn install –DskipTests) without any errors:

1) Open command prompt with administrator

2) Change repo link to: http://repo.hortonworks.com/content/groups/public

3) Require protoc.exe version 2.5.0

4) Require msbuild.exe from Visual Studio 2010

5) Install cmake.exe

It should be mentioned in BUILDING.txt.