Reply
New Contributor
Posts: 2
Registered: ‎06-20-2017

Cannot build MRv1 source from hadoop-2.6.0-cdh5.11.1-src.tar

I'm currently trying to some parts of MRv1 source code.

CDH was my choice as the official hadoop does not manage MRv1 anymore but CDH does.

 

The entire projects except for hadoop-mapreduce1-project were built without any issues by typing the command 'mvn package -Ddist,native -DskipTests -Dtar' from the root of the source directoy hierarchy.

The problem is that the uppermost pom.xml does not handle hadoop-mapreduce1-project.

 

So I look into hadoop-mapreduce1-project, and found that this project is seperately managed by ant, not maven.

Typing 'ant package' from hadoop-mapreduce1-project directory should be enough, but it fails to resolve dependency.

I also tried a maven wrapper inside hadoop-mapreduce1-project/cloudera/maven-packaging, but it was still stuck by the same problem from ant.

 

Here's some last parts of error log:

 

[ivy:resolve] :: downloading artifacts ::
[ivy:resolve]   [NOT REQUIRED] commons-logging#commons-logging;1.1.3!commons-logging.jar
[ivy:resolve]   [NOT REQUIRED] org.mortbay.jetty#jetty-util;6.1.26.cloudera.4!jetty-util.jar
[ivy:resolve]   [NOT REQUIRED] org.mortbay.jetty#jetty;6.1.26.cloudera.4!jetty.jar
[ivy:resolve]   [NOT REQUIRED] commons-httpclient#commons-httpclient;3.1!commons-httpclient.jar
[ivy:resolve]   [NOT REQUIRED] commons-codec#commons-codec;1.4!commons-codec.jar
[ivy:resolve] :: resolution report :: resolve 18770ms :: artifacts dl 4ms
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      common      |   10  |   0   |   0   |   0   ||   5   |   0   |
        ---------------------------------------------------------------------
[ivy:resolve] WARN:     ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] WARN:     ::          UNRESOLVED DEPENDENCIES         ::
[ivy:resolve] WARN:     ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] WARN:     :: junit#junit;4.8.1: several problems occurred while resolving dependency: junit#junit;4.8.1 {common=[default]}:
[ivy:resolve]   reactor-repo: unable to get resource for junit#junit;4.8.1: res=${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.pom
[ivy:resolve]   reactor-repo: unable to get resource for junit#junit;4.8.1: res=${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve]   reactor-repo: unable to get resource for junit#junit;4.8.1: res=${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve] WARN:     :: log4j#log4j;1.2.16: several problems occurred while resolving dependency: log4j#log4j;1.2.16 {common=[master]}:
[ivy:resolve]   reactor-repo: unable to get resource for log4j#log4j;1.2.16: res=${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.pom
[ivy:resolve]   reactor-repo: unable to get resource for log4j#log4j;1.2.16: res=${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.jar
[ivy:resolve]   reactor-repo: unable to get resource for log4j#log4j;1.2.16: res=${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.jar
[ivy:resolve] WARN:     :: org.mortbay.jetty#servlet-api;2.5-20081211: several problems occurred while resolving dependency: org.mortbay.jetty#servlet-api;2.5-20081211 {compile=[compile(*), master(*)], runtime=[runtime(*)]}:
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#servlet-api;2.5-20081211: res=${reactor.repo}/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.pom
[ivy:resolve]   several problems occurred while resolving dependency: org.mortbay.jetty#jetty-parent;7 {}:
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#jetty-parent;7: res=${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.pom
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#jetty-parent;7: res=${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#jetty-parent;7: res=${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar
[ivy:resolve]   several problems occurred while resolving dependency: org.mortbay.jetty#jetty-parent;7 {}:
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#jetty-parent;7: res=${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.pom
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#jetty-parent;7: res=${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#jetty-parent;7: res=${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar
[ivy:resolve] WARN:     :: org.codehaus.jackson#jackson-mapper-asl;1.0.1: several problems occurred while resolving dependency: org.codehaus.jackson#jackson-mapper-asl;1.0.1 {common=[default]}:
[ivy:resolve]   reactor-repo: unable to get resource for org/codehaus/jackson#jackson-mapper-asl;1.0.1: res=${reactor.repo}/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.pom
[ivy:resolve]   reactor-repo: unable to get resource for org/codehaus/jackson#jackson-mapper-asl;1.0.1: res=${reactor.repo}/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.jar
[ivy:resolve]   reactor-repo: unable to get resource for org/codehaus/jackson#jackson-mapper-asl;1.0.1: res=${reactor.repo}/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.jar
[ivy:resolve] WARN:     :: org.codehaus.jackson#jackson-core-asl;1.0.1: several problems occurred while resolving dependency: org.codehaus.jackson#jackson-core-asl;1.0.1 {common=[default]}:
[ivy:resolve]   reactor-repo: unable to get resource for org/codehaus/jackson#jackson-core-asl;1.0.1: res=${reactor.repo}/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.pom
[ivy:resolve]   reactor-repo: unable to get resource for org/codehaus/jackson#jackson-core-asl;1.0.1: res=${reactor.repo}/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.jar
[ivy:resolve]   reactor-repo: unable to get resource for org/codehaus/jackson#jackson-core-asl;1.0.1: res=${reactor.repo}/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.jar
[ivy:resolve] WARN:     ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] Nbr of module to sort : 5
[ivy:resolve] Sort dependencies of : commons-logging#commons-logging;1.1.3 / Number of dependencies = 5
[ivy:resolve] Sort done for : commons-logging#commons-logging;1.1.3
[ivy:resolve] Sort dependencies of : org.mortbay.jetty#jetty-util;6.1.26.cloudera.4 / Number of dependencies = 3
[ivy:resolve] Sort done for : org.mortbay.jetty#jetty-util;6.1.26.cloudera.4
[ivy:resolve] Sort dependencies of : org.mortbay.jetty#jetty;6.1.26.cloudera.4 / Number of dependencies = 3
[ivy:resolve] Module descriptor is processed : org.mortbay.jetty#jetty-util;6.1.26.cloudera.4
[ivy:resolve] Sort done for : org.mortbay.jetty#jetty;6.1.26.cloudera.4
[ivy:resolve] Sort dependencies of : commons-httpclient#commons-httpclient;3.1 / Number of dependencies = 3
[ivy:resolve] Non matching revision detected when sorting.  commons-httpclient#commons-httpclient depends on commons-logging#commons-logging;1.0.4, doesn't match commons-logging#commons-logging;1.1.3
[ivy:resolve] Non matching revision detected when sorting.  commons-httpclient#commons-httpclient depends on commons-codec#commons-codec;1.2, doesn't match commons-codec#commons-codec;1.4
[ivy:resolve] Sort done for : commons-httpclient#commons-httpclient;3.1
[ivy:resolve] Sort dependencies of : commons-codec#commons-codec;1.4 / Number of dependencies = 1
[ivy:resolve] Sort done for : commons-codec#commons-codec;1.4
[ivy:resolve]   report for org.apache.hadoop#capacity-scheduler;working@TRUSTY100 common produced in /home/trusty00/.ivy2/cache/org.apache.hadoop-capacity-scheduler-common.xml
[ivy:resolve]   resolve done (18770ms resolve - 4ms download)
[ivy:resolve] 
[ivy:resolve] :: problems summary ::
[ivy:resolve] :::: WARNINGS
[ivy:resolve]           ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve]           ::          UNRESOLVED DEPENDENCIES         ::
[ivy:resolve]           ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve]           :: junit#junit;4.8.1: several problems occurred while resolving dependency: junit#junit;4.8.1 {common=[default]}:
[ivy:resolve]   reactor-repo: unable to get resource for junit#junit;4.8.1: res=${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.pom
[ivy:resolve]   reactor-repo: unable to get resource for junit#junit;4.8.1: res=${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve]   reactor-repo: unable to get resource for junit#junit;4.8.1: res=${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve]           :: log4j#log4j;1.2.16: several problems occurred while resolving dependency: log4j#log4j;1.2.16 {common=[master]}:
[ivy:resolve]   reactor-repo: unable to get resource for log4j#log4j;1.2.16: res=${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.pom
[ivy:resolve]   reactor-repo: unable to get resource for log4j#log4j;1.2.16: res=${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.jar
[ivy:resolve]   reactor-repo: unable to get resource for log4j#log4j;1.2.16: res=${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/log4j/log4j/1.2.16/log4j-1.2.16.jar
[ivy:resolve]           :: org.mortbay.jetty#servlet-api;2.5-20081211: several problems occurred while resolving dependency: org.mortbay.jetty#servlet-api;2.5-20081211 {compile=[compile(*), master(*)], runtime=[runtime(*)]}:
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#servlet-api;2.5-20081211: res=${reactor.repo}/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.pom
[ivy:resolve]   several problems occurred while resolving dependency: org.mortbay.jetty#jetty-parent;7 {}:
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#jetty-parent;7: res=${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.pom
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#jetty-parent;7: res=${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#jetty-parent;7: res=${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar
[ivy:resolve]   several problems occurred while resolving dependency: org.mortbay.jetty#jetty-parent;7 {}:
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#jetty-parent;7: res=${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.pom
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#jetty-parent;7: res=${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar
[ivy:resolve]   reactor-repo: unable to get resource for org/mortbay/jetty#jetty-parent;7: res=${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.jar
[ivy:resolve]           :: org.codehaus.jackson#jackson-mapper-asl;1.0.1: several problems occurred while resolving dependency: org.codehaus.jackson#jackson-mapper-asl;1.0.1 {common=[default]}:
[ivy:resolve]   reactor-repo: unable to get resource for org/codehaus/jackson#jackson-mapper-asl;1.0.1: res=${reactor.repo}/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.pom
[ivy:resolve]   reactor-repo: unable to get resource for org/codehaus/jackson#jackson-mapper-asl;1.0.1: res=${reactor.repo}/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.jar
[ivy:resolve]   reactor-repo: unable to get resource for org/codehaus/jackson#jackson-mapper-asl;1.0.1: res=${reactor.repo}/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/codehaus/jackson/jackson-mapper-asl/1.0.1/jackson-mapper-asl-1.0.1.jar
[ivy:resolve]           :: org.codehaus.jackson#jackson-core-asl;1.0.1: several problems occurred while resolving dependency: org.codehaus.jackson#jackson-core-asl;1.0.1 {common=[default]}:
[ivy:resolve]   reactor-repo: unable to get resource for org/codehaus/jackson#jackson-core-asl;1.0.1: res=${reactor.repo}/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.pom
[ivy:resolve]   reactor-repo: unable to get resource for org/codehaus/jackson#jackson-core-asl;1.0.1: res=${reactor.repo}/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.jar
[ivy:resolve]   reactor-repo: unable to get resource for org/codehaus/jackson#jackson-core-asl;1.0.1: res=${reactor.repo}/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/org/codehaus/jackson/jackson-core-asl/1.0.1/jackson-core-asl-1.0.1.jar
[ivy:resolve]           ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] 
[ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
   [subant] Exiting /home/trusty00/hadoop-2.6.0-cdh5.11.1/hadoop-mapreduce1-project/src/contrib/capacity-scheduler/build.xml.
   [subant] Exiting /home/trusty00/hadoop-2.6.0-cdh5.11.1/hadoop-mapreduce1-project/src/contrib/build.xml.

BUILD FAILED
/home/trusty00/hadoop-2.6.0-cdh5.11.1/hadoop-mapreduce1-project/build.xml:610: The following error occurred while executing this line:
/home/trusty00/hadoop-2.6.0-cdh5.11.1/hadoop-mapreduce1-project/src/contrib/build.xml:30: The following error occurred while executing this line:
/home/trusty00/hadoop-2.6.0-cdh5.11.1/hadoop-mapreduce1-project/src/contrib/build-contrib.xml:455: impossible to resolve dependencies:
        resolve failed - see output for details
        at org.apache.ivy.ant.IvyResolve.doExecute(IvyResolve.java:251)
        at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:277)
        at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:292)
        at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
        at org.apache.tools.ant.Task.perform(Task.java:348)
        at org.apache.tools.ant.Target.execute(Target.java:435)
        at org.apache.tools.ant.Target.performTasks(Target.java:456)
        at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1393)
        at org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
        at org.apache.tools.ant.Project.executeTargets(Project.java:1248)
        at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:440)
        at org.apache.tools.ant.taskdefs.SubAnt.execute(SubAnt.java:306)
        at org.apache.tools.ant.taskdefs.SubAnt.execute(SubAnt.java:221)
        at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:292)
        at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
        at org.apache.tools.ant.Task.perform(Task.java:348)
        at org.apache.tools.ant.Target.execute(Target.java:435)
        at org.apache.tools.ant.Target.performTasks(Target.java:456)
        at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1393)
        at org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
        at org.apache.tools.ant.Project.executeTargets(Project.java:1248)
        at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:440)
        at org.apache.tools.ant.taskdefs.SubAnt.execute(SubAnt.java:306)
        at org.apache.tools.ant.taskdefs.SubAnt.execute(SubAnt.java:221)
        at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:292)
        at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
        at org.apache.tools.ant.Task.perform(Task.java:348)
        at org.apache.tools.ant.Target.execute(Target.java:435)
        at org.apache.tools.ant.Target.performTasks(Target.java:456)
        at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1393)
        at org.apache.tools.ant.Project.executeTarget(Project.java:1364)
        at org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
        at org.apache.tools.ant.Project.executeTargets(Project.java:1248)
        at org.apache.tools.ant.Main.runBuild(Main.java:851)
        at org.apache.tools.ant.Main.startAnt(Main.java:235)
        at org.apache.tools.ant.launch.Launcher.run(Launcher.java:280)
        at org.apache.tools.ant.launch.Launcher.main(Launcher.java:109)

Total time: 1 minute 12 seconds

 

junit seems to be the first failed one. So grep junit:

 

[ivy:resolve]   no ivy file in cache for junit#junit;4.8.1: tried /home/trusty00/.ivy2/cache/junit/junit/ivy-4.8.1.xml
[ivy:resolve]    trying https://repository.cloudera.com/artifactory/cdh-releases-rcs/junit/junit/4.8.1/junit-4.8.1.pom
[ivy:resolve]           tried https://repository.cloudera.com/artifactory/cdh-releases-rcs/junit/junit/4.8.1/junit-4.8.1.pom
[ivy:resolve]   cdh-releases: found md file for junit#junit;4.8.1
[ivy:resolve]           => https://repository.cloudera.com/artifactory/cdh-releases-rcs/junit/junit/4.8.1/junit-4.8.1.pom (4.8.1)
[ivy:resolve]   no ivy file in cache for junit#junit;4.8.1: tried /home/trusty00/.ivy2/cache/junit/junit/ivy-4.8.1.xml
[ivy:resolve] downloading https://repository.cloudera.com/artifactory/cdh-releases-rcs/junit/junit/4.8.1/junit-4.8.1.pom ...
[ivy:resolve]   cdh-releases: downloading https://repository.cloudera.com/artifactory/cdh-releases-rcs/junit/junit/4.8.1/junit-4.8.1.pom
[ivy:resolve]           to /home/trusty00/.ivy2/cache/junit/junit/ivy-4.8.1.xml.original.part
[ivy:resolve] sha1 file found for https://repository.cloudera.com/artifactory/cdh-releases-rcs/junit/junit/4.8.1/junit-4.8.1.pom: checking...
[ivy:resolve]   cdh-releases: downloading https://repository.cloudera.com/artifactory/cdh-releases-rcs/junit/junit/4.8.1/junit-4.8.1.pom.sha1
[ivy:resolve] sha1 OK for https://repository.cloudera.com/artifactory/cdh-releases-rcs/junit/junit/4.8.1/junit-4.8.1.pom
[ivy:resolve]   [SUCCESSFUL ] junit#junit;4.8.1!junit.pom(pom.original) (1140ms)
[ivy:resolve]    trying ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve]           tried ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve] problem occurred while resolving dependency: junit#junit;4.8.1 {common=[default]} with cdh-releases: java.lang.RuntimeException: reactor-repo: unable to get resource for junit#junit;4.8.1: res=${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve] Caused by: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve] don't use cache for junit#junit;4.8.1: checkModified=true
[ivy:resolve]    trying https://repository.cloudera.com/artifactory/libs-snapshot-local/junit/junit/4.8.1/junit-4.8.1.pom
[ivy:resolve]           tried https://repository.cloudera.com/artifactory/libs-snapshot-local/junit/junit/4.8.1/junit-4.8.1.pom
[ivy:resolve] HTTP response status: 409 url=https://repository.cloudera.com/artifactory/libs-snapshot-local/junit/junit/4.8.1/junit-4.8.1.pom
[ivy:resolve] CLIENT ERROR: Conflict url=https://repository.cloudera.com/artifactory/libs-snapshot-local/junit/junit/4.8.1/junit-4.8.1.pom
[ivy:resolve]   cloudera-snapshot: resource not reachable for junit#junit;4.8.1: res=https://repository.cloudera.com/artifactory/libs-snapshot-local/junit/junit/4.8.1/junit-4.8.1.pom
[ivy:resolve]    trying https://repository.cloudera.com/artifactory/libs-snapshot-local/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve]           tried https://repository.cloudera.com/artifactory/libs-snapshot-local/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve] HTTP response status: 409 url=https://repository.cloudera.com/artifactory/libs-snapshot-local/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve] CLIENT ERROR: Conflict url=https://repository.cloudera.com/artifactory/libs-snapshot-local/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve]   cloudera-snapshot: resource not reachable for junit#junit;4.8.1: res=https://repository.cloudera.com/artifactory/libs-snapshot-local/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve]   cloudera-snapshot: no ivy file nor artifact found for junit#junit;4.8.1
[ivy:resolve] dependency descriptor has been mediated: dependency: junit#junit;4.8.1 {common=[default]} => dependency: junit junit;3.8.2 {common=[default]}
[ivy:resolve] dependency descriptor has been mediated: dependency: junit#junit;4.8.1 {common=[default]} => dependency: junit junit;3.8.2 {common=[default]}
[ivy:resolve] WARN:     :: junit#junit;4.8.1: several problems occurred while resolving dependency: junit#junit;4.8.1 {common=[default]}:
[ivy:resolve]   reactor-repo: unable to get resource for junit#junit;4.8.1: res=${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.pom
[ivy:resolve]   reactor-repo: unable to get resource for junit#junit;4.8.1: res=${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve]   reactor-repo: unable to get resource for junit#junit;4.8.1: res=${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve]           :: junit#junit;4.8.1: several problems occurred while resolving dependency: junit#junit;4.8.1 {common=[default]}:
[ivy:resolve]   reactor-repo: unable to get resource for junit#junit;4.8.1: res=${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.pom: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.pom
[ivy:resolve]   reactor-repo: unable to get resource for junit#junit;4.8.1: res=${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar
[ivy:resolve]   reactor-repo: unable to get resource for junit#junit;4.8.1: res=${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar: java.net.MalformedURLException: no protocol: ${reactor.repo}/junit/junit/4.8.1/junit-4.8.1.jar

 

As you see, junit download is both tried through https://repository.cloudera.com/artifactory/cdh-releases-rcs/ and  https://repository.cloudera.com/artifactory/libs-snapshot-local/

The release (former) access has succeeded, while the snapshot (latter) access has failed.

 

Indeed, if manually accessed by somthing like 'curl https://repository.cloudera.com/artifactory/libs-snapshot-local/junit/junit/4.8.1/junit-4.8.1.jar', it gives the following message:

{
  "errors" : [ {
    "status" : 409,
    "message" : "The repository 'libs-snapshot-local' rejected the resolution of an artifact 'libs-snapshot-local:junit/junit/4.8.1/junit-4.8.1.jar' due to conflict in the snapshot release handling policy."
  } ]
}

On the other hand, 'wget https://repository.cloudera.com/artifactory/cdh-releases-rcs/junit/junit/4.8.1/junit-4.8.1.jar' actually download the jar file.

 

I think there are two suspicious points:

1. The same junit-4.8.1.pom file is tried to be downloaded from both release and snapshot repos. That seems to give '[ivy:resolve] CLIENT ERROR: Conflict url=' error. Maybe ivy/ivysettings.xml misconfigured chain resolver?

2. Currently the snapshot repo is not the same as the original distributor's view. This seems to give 'HTTP response status: 409 url=' error.

 

I still do not have any solutions. Any help?

New Contributor
Posts: 2
Registered: ‎06-20-2017

Re: Cannot build MRv1 source from hadoop-2.6.0-cdh5.11.1-src.tar

[ Edited ]

 

A simple solution was just removing any reactor-repo resolver.

 

ivy/ivysettings.xml (before):

<chain name="default" dual="true"
       checkmodified="true"
       changingPattern=".*SNAPSHOT">
  <resolver ref="reactor-repo"/>
  <resolver ref="local"/>
  <resolver ref="maven2"/>
  <resolver ref="cdh-releases"/>
  <resolver ref="cloudera-snapshot"/>
</chain>
<chain name="internal">
  <resolver ref="reactor-repo"/>
  <resolver ref="local"/>
</chain>
<chain name="external">
  <resolver ref="maven2"/>
  <resolver ref="cdh-releases"/>
</chain>
<chain name="external-and-snapshots">
  <resolver ref="reactor-repo"/>
  <resolver ref="maven2"/>
  <resolver ref="cdh-releases"/>
  <resolver ref="apache-snapshot"/>
  <resolver ref="cloudera-snapshot"/>
</chain>

ivy/ivysettings.xml (after):

<chain name="default" dual="true"
       checkmodified="true"
       changingPattern=".*SNAPSHOT">
  <resolver ref="local"/>
  <resolver ref="maven2"/>
  <resolver ref="cdh-releases"/>
  <resolver ref="cloudera-snapshot"/>
</chain>
<chain name="internal">
  <resolver ref="maven2"/>
  <resolver ref="local"/>
</chain>
<chain name="external">
  <resolver ref="maven2"/>
  <resolver ref="cdh-releases"/>
</chain>
<chain name="external-and-snapshots">
  <resolver ref="maven2"/>
  <resolver ref="cdh-releases"/>
  <resolver ref="apache-snapshot"/>
  <resolver ref="cloudera-snapshot"/>
</chain>

For "internal" chain, I also put maven2 repo to resolve any missing dependency. Others chains already have it in so no problem.

 

I'm not sure this is right thing to do, but anyway I can build it now.

 

One more thing. I used 'pacakage' as the ant build target, but it tries to build unwanted 'docs' target which requires apach forrest installation. For my purpose, 'binary' target was sufficient.

Announcements