Member since
12-13-2015
9
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2374 | 01-19-2016 04:27 PM |
08-24-2017
08:06 PM
Greetings, is the source code for the windows installations available? Specifically the code to generate the msi and .cab files? I am having trouble upgrading my machine(s) to the latest available version of hdp and I think it would be easiest to just debug the installation. Thanks in advance!
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)
01-19-2016
04:27 PM
To summarize, I have found no technical reason why other versions of Windows is not supported. I believe it is more of a strategic decision.
... View more
01-10-2016
04:09 AM
Yes, thank you, but I was able to get it working on Windows 8.1 by manually installing it. I'm curious as to why only Server versions. Is it a technical reason? And if so, what? Best regards.
... View more
01-09-2016
10:29 PM
Is there a technical reason why HDP is not supported for Windows versions other than Windows Server? I installed HDP on two Server 2012 machines, but the install failed when I tried it on Windows 8.1. I manually configured it for my Windows 8.1 box and the cluster seems to work fine. I'm concerned there is a technical roadblock in my future that I just haven't hit yet. Will that be the case? Ultimately, I may have evening access to about 100 PCs, but they are running Windows 7. I'd like to install HDP on them, but of course want to save myself a lot of headaches if there is a reason it won't work. Thanks in advance!
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)
12-15-2015
08:43 PM
Please ignore this post. stevel's post above solved the problem. It wasn't available with this second post.
... View more
12-15-2015
08:41 PM
Thanks. For others, please ignore my next post. stevel solved it for me.
... View more
12-14-2015
08:29 PM
1 Kudo
Greetings, I'm still struggling with this. In my effort to start out concise, I'm not sure I gave enough detail. I believe I've encountered a wider issue with the "hwx" version of jetty-utils. I downloaded the HDP installer for Windows and got it up and running. I would now like to build the source included with the HDP installer. The zip bundle has hdp-2.3.0.0.winpkg.msi and 2.3.0.0.sources.zip. I installed the msi and configured Hadoop with few difficulties. I would now like to build the source. I have built a few different versions of Hadoop with success, but not this particular one. As I mentioned above, this one particular version of jetty-utils appears to be missing from all the repositories. Here is what another person had to say (http://mail-archives.apache.org/mod_mbox/incubator-flink-issues/201509.mbox/%3Cgit-pr-1113-flink@git.apache.org%3E😞 "Certain HDP-specific Hadoop releases depend on
```
[INFO] | +- org.mortbay.jetty:jetty:jar:6.1.26.hwx:compile
[INFO] | +- org.mortbay.jetty:jetty-util:jar:6.1.26.hwx:compile
```
Which is only available in a special Hortonworks repository...Usually, we exclude jetty and other libraries which are only needed for Hadoop's web interfaces...This change does not affect the regular builds, because the additional repository is "hidden" by the maven build profile." It seems from that post that the problems I'm encountering with this odd "hwx" version are a little deeper than permissions or maven configuration. Any help would be greatly appreciated. Following is a more complete listing of the build log:
[WARNING] Javadoc Warnings
[WARNING] C:\Users\walkadmin.SRV\.m2\repository\org\apache\directory\api\api-ldap-model\1.0.0-M20\api-ldap-model-1.0.0-M20.jar(org/apache/directory/api/ldap/model/name/Dn.class): warning: Cannot find annotation method 'value()' in type 'SuppressWarnings': class file for edu.umd.cs.findbugs.annotations.SuppressWarnings not found
[WARNING] C:\Users\walkadmin.SRV\.m2\repository\org\apache\directory\api\api-ldap-model\1.0.0-M20\api-ldap-model-1.0.0-M20.jar(org/apache/directory/api/ldap/model/name/Dn.class): warning: Cannot find annotation method 'justification()' in type 'SuppressWarnings'
[INFO] Building jar: E:\Cus\bld\h2557\src.1\hadoop-2.7.1.2.3.0.0-2557\hadoop-common-project\hadoop-minikdc\target\hadoop-minikdc-2.7.1-SNAPSHOT-javadoc.jar
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Auth 2.7.1-SNAPSHOT
[INFO] ------------------------------------------------------------------------
Downloading: https://repository.apache.org/content/repositories/snapshots/org/mortbay/jetty/jetty/6.1.26.hwx/jetty-6.1.26.hwx.pom Downloading: http://repository.jboss.org/nexus/content/groups/public/org/mortbay/jetty/jetty/6.1.26.hwx/jetty-6.1.26.hwx.pom Downloading: https://repo.maven.apache.org/maven2/org/mortbay/jetty/jetty/6.1.26.hwx/jetty-6.1.26.hwx.pom [WARNING] The POM for org.mortbay.jetty:jetty:jar:6.1.26.hwx is missing, no dependency information available
Downloading: https://repository.apache.org/content/repositories/snapshots/org/mortbay/jetty/jetty/6.1.26.hwx/jetty-6.1.26.hwx.jar Downloading: http://repository.jboss.org/nexus/content/groups/public/org/mortbay/jetty/jetty/6.1.26.hwx/jetty-6.1.26.hwx.jar Downloading: https://repo.maven.apache.org/maven2/org/mortbay/jetty/jetty/6.1.26.hwx/jetty-6.1.26.hwx.jar [INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 12.872 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 0.641 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 1.601 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.097 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 1.960 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 1.445 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 1.159 s]
[INFO] Apache Hadoop Auth ................................. FAILURE [ 17.711 s]
[INFO] Apache Hadoop Auth Examples ........................ SKIPPED
[INFO] Apache Hadoop Common ............................... SKIPPED
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-server-sharedcachemanager .............. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Azure support ........................ SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 39.091 s
[INFO] Finished at: 2015-12-13T21:22:51-06:00
[INFO] Final Memory: 78M/720M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project hadoop-auth: Could not resolve dependencies for project org.apache.hadoop:hadoop-auth:jar:2.7.1-SNAPSHOT: Could not find artifact org.mortbay.jetty:jetty:jar:6.1.26.hwx in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal on project hadoop-auth: Could not resolve dependencies for project org.apache.hadoop:hadoop-auth:jar:2.7.1-SNAPSHOT: Could not find artifact org.mortbay.jetty:jetty:jar:6.1.26.hwx in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots)
at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:221)
at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies(LifecycleDependencyResolver.java:127)
at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved(MojoExecutor.java:245)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:199)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.project.DependencyResolutionException: Could not resolve dependencies for project org.apache.hadoop:hadoop-auth:jar:2.7.1-SNAPSHOT: Could not find artifact org.mortbay.jetty:jetty:jar:6.1.26.hwx in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots)
at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:211)
at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.java:195)
... 23 more
Caused by: org.eclipse.aether.resolution.DependencyResolutionException: Could not find artifact org.mortbay.jetty:jetty:jar:6.1.26.hwx in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots)
at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:384)
at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve(DefaultProjectDependenciesResolver.java:205)
... 24 more
Caused by: org.eclipse.aether.resolution.ArtifactResolutionException: Could not find artifact org.mortbay.jetty:jetty:jar:6.1.26.hwx in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:444)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts(DefaultArtifactResolver.java:246)
at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies(DefaultRepositorySystem.java:367)
... 25 more
Caused by: org.eclipse.aether.transfer.ArtifactNotFoundException: Could not find artifact org.mortbay.jetty:jetty:jar:6.1.26.hwx in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots)
at org.eclipse.aether.connector.basic.ArtifactTransportListener.transferFailed(ArtifactTransportListener.java:39)
at org.eclipse.aether.connector.basic.BasicRepositoryConnector$TaskRunner.run(BasicRepositoryConnector.java:355)
at org.eclipse.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:67)
at org.eclipse.aether.connector.basic.BasicRepositoryConnector$DirectExecutor.execute(BasicRepositoryConnector.java:581)
at org.eclipse.aether.connector.basic.BasicRepositoryConnector.get(BasicRepositoryConnector.java:249)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.performDownloads(DefaultArtifactResolver.java:520)
at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve(DefaultArtifactResolver.java:421)
... 27 more
[ERROR]
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-auth
... View more
12-14-2015
12:21 AM
1 Kudo
How does one build Hadoop Auth 2.7.1-SNAPSHOT? As near as I can tell, jetty-util-6.1.26.hwx is unavailable. I notice that somebody else had a similar problem, but it hasn't helped me: http://mail-archives.apache.org/mod_mbox/incubator-flink-issues/201509.mbox/%3Cgit-pr-1113-flink@git.apache.org%3E Following are the build errors:
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop Auth 2.7.1-SNAPSHOT
[INFO] ------------------------------------------------------------------------
Downloading: https://repository.apache.org/content/repositories/snapshots/org/mortbay/jetty/jetty-util/6.1.26.hwx/jetty-util-6.1.26.hwx.pom
Downloading: http://repository.jboss.org/nexus/content/groups/public/org/mortbay/jetty/jetty-util/6.1.26.hwx/jetty-util-6.1.26.hwx.pom
Downloading: https://repo.maven.apache.org/maven2/org/mortbay/jetty/jetty-util/6.1.26.hwx/jetty-util-6.1.26.hwx.pom
[WARNING] The POM for org.mortbay.jetty:jetty-util:jar:6.1.26.hwx is missing, no dependency information available
[WARNING] The POM for org.mortbay.jetty:jetty:jar:6.1.26.hwx is missing, no dependency information available
Downloading: https://repository.apache.org/content/repositories/snapshots/org/mortbay/jetty/jetty-util/6.1.26.hwx/jetty-util-6.1.26.hwx.jar
Downloading: http://repository.jboss.org/nexus/content/groups/public/org/mortbay/jetty/jetty-util/6.1.26.hwx/jetty-util-6.1.26.hwx.jar
Downloading: https://repo.maven.apache.org/maven2/org/mortbay/jetty/jetty-util/6.1.26.hwx/jetty-util-6.1.26.hwx.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 0.941 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 0.677 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 1.440 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.094 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 1.603 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 1.539 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 1.173 s]
[INFO] Apache Hadoop Auth ................................. FAILURE [ 21.470 s]
[INFO] Apache Hadoop Auth Examples ........................ SKIPPED
[INFO] Apache Hadoop Common ............................... SKIPPED
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
... View more
Labels:
- Labels:
-
Apache Flink
-
Apache Hadoop
12-13-2015
03:37 PM
Greetings, Where is the source code for Hadoop 2.7.1.2.3.0.0-2557 and the related dependencies? I have found a number of source code repositories and versions, but I can't seem to find this specific version anywhere. As an aside, I am building on Windows. Thanks, Cary
... View more
Labels:
- Labels:
-
Apache Hadoop