Error while installing Oozie 4.0.0 in Hadoop 2.5.2 (Fails at Apache Oozie Core step)

[#1]

hi,

im trying to install Oozie in Ubuntu 16.04 with Hadoop-2.5.2, im facing some issue in Apache Oozie Core step... i have tried all the possible posts from Google can't find proper solution for this Error as bellow.

Environment Details:

Hadoop-2.5.2

JDK1.7.0_80

Hbase-0.98.8

oozie-4.0.0

[INFO] ------------------------------------------------------------------------

[INFO] Building Apache Oozie Core 4.0.0 [INFO] ------------------------------------------------------------------------

[WARNING] The POM for org.apache.oozie:oozie-hbase:jar:0.98.8.oozie-4.0.0 is missing, no dependency information available [WARNING] Failure to transfer asm:asm/maven-metadata.xml from file:../../local.repository/trunk was cached in the local repository, resolution will not be reattempted until the update interval of local.repository has elapsed or updates are forced. Original error: Could not transfer metadata asm:asm/maven-metadata.xml from/to local.repository (file:../../local.repository/trunk): Cannot access file:../../local.repository/trunk with type legacy using the available connector factories: BasicRepositoryConnectorFactory

[INFO] ------------------------------------------------------------------------

[INFO] Reactor Summary:

[INFO]

[INFO] Apache Oozie Main .................................. SUCCESS [ 1.794 s]

[INFO] Apache Oozie Client ................................ SUCCESS [ 31.610 s]

[INFO] Apache Oozie Hadoop 1.1.1.oozie-4.0.0 .............. SUCCESS [ 0.733 s]

[INFO] Apache Oozie Hadoop Distcp 1.1.1.oozie-4.0.0 ....... SUCCESS [ 0.065 s]

[INFO] Apache Oozie Hadoop 1.1.1.oozie-4.0.0 Test ......... SUCCESS [ 0.130 s]

[INFO] Apache Oozie Hadoop 2.5.2.oozie-4.0.0 .............. SUCCESS [ 4.122 s]

[INFO] Apache Oozie Hadoop 2.5.2.oozie-4.0.0 Test ......... SUCCESS [ 0.187 s]

[INFO] Apache Oozie Hadoop Distcp 2.5.2.oozie-4.0.0 ....... SUCCESS [ 0.058 s]

[INFO] Apache Oozie Hadoop 0.23.5.oozie-4.0.0 ............. SUCCESS [ 2.602 s]

[INFO] Apache Oozie Hadoop 0.23.5.oozie-4.0.0 Test ........ SUCCESS [ 0.186 s]

[INFO] Apache Oozie Hadoop Distcp 0.23.5.oozie-4.0.0 ...... SUCCESS [ 0.052 s]

[INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [ 2.656 s]

[INFO] Apache Oozie Hbase 0.94.2.oozie-4.0.0 .............. SUCCESS [ 0.237 s]

[INFO] Apache Oozie Hbase Libs ............................ SUCCESS [ 0.524 s]

[INFO] Apache Oozie HCatalog 0.5.0.oozie-4.0.0 ............ SUCCESS [ 0.708 s]

[INFO] Apache Oozie HCatalog 0.6.0.oozie-4.0.0 ............ SUCCESS [ 0.563 s]

[INFO] Apache Oozie HCatalog Libs ......................... SUCCESS [ 1.451 s]

[INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [ 6.499 s]

[INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [ 3.981 s]

[INFO] Apache Oozie Core .................................. FAILURE [ 0.237 s]

[INFO] Apache Oozie Docs .................................. SKIPPED

[INFO] Apache Oozie Share Lib Pig ......................... SKIPPED

[INFO] Apache Oozie Share Lib Hive ........................ SKIPPED

[INFO] Apache Oozie Share Lib Sqoop ....................... SKIPPED

[INFO] Apache Oozie Share Lib Streaming ................... SKIPPED

[INFO] Apache Oozie Share Lib Distcp ...................... SKIPPED

[INFO] Apache Oozie WebApp ................................ SKIPPED

[INFO] Apache Oozie Examples .............................. SKIPPED

[INFO] Apache Oozie Share Lib ............................. SKIPPED

[INFO] Apache Oozie Tools ................................. SKIPPED

[INFO] Apache Oozie MiniOozie ............................. SKIPPED

[INFO] Apache Oozie Distro ................................ SKIPPED

[INFO] ------------------------------------------------------------------------

[INFO] BUILD FAILURE

[INFO] ------------------------------------------------------------------------

[INFO] Total time: 01:00 min

[INFO] Finished at: 2017-04-05T03:00:46-07:00

[INFO] Final Memory: 74M/416M

[INFO] ------------------------------------------------------------------------

[ERROR] Failed to execute goal on project oozie-core: Could not resolve dependencies for project org.apache.oozie:oozie-core:jar:4.0.0: Failure to find org.apache.oozie:oozie-hbase:jar:0.98.8.oozie-4.0.0 in http://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1]

[ERROR]

[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.

[ERROR] Re-run Maven using the -X switch to enable full debug logging.

[ERROR]

[ERROR] For more information about the errors and possible solutions, please read the following articles:

[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

[ERROR]

[ERROR] After correcting the problems, you can resume the build with the command

[ERROR] mvn <goals> -rf :oozie-core

ERROR, Oozie distro creation failed

i have reffed the the following site: https://gauravkohli.com/2014/08/26/apache-oozie-installation-on-hadoop-2-4-1/

[#2]

@Manikandan Jeyabal

In your logs we see that it is referring to "http://repo1.maven.org/maven2"

Could not resolve dependencies for project org.apache.oozie:oozie-core:jar:4.0.0: Failure to find org.apache.oozie:oozie-hbase:jar:0.98.8.oozie-4.0.0 in http://repo1.maven.org/maven2 was cached in the local repository, resolution will not be reattempted until the update interval of central has elapsed or updates are forced -> [Help 1] 

.

Can you check the following repo and retry the build:

http://repo.hortonworks.com/content/repositories/releases/org/apache/oozie/oozie-core/
OR
http://repo.hortonworks.com/content/groups/public/org/apache/oozie/oozie-core/

Please see: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_installing_manually_book/content/ch01s13...

[#3]

Hi Jay,

for the First URL "

1. http://repo.hortonworks.com/content/repositories/releases/org/apache/oozie/oozie-core/ "

i'm getting the following Error :

Failed to execute goal on project oozie-core: Could not resolve dependencies for project org.apache.oozie:oozie-core:jar:4.0.0: Could not find artifact org.apache.oozie:oozie-hbase:jar:0.98.8.oozie-4.0.0 in central (http://repo.hortonworks.com/content/repositories/releases/org/apache/oozie/oozie-core/)

and for the 2'nd URL im getting the following Error '

"Failed to execute goal on project oozie-core: Could not resolve dependencies for project org.apache.oozie:oozie-core:jar:4.0.0: Could not find artifact org.apache.oozie:oozie-hbase:jar:0.98.8.oozie-4.0.0 in central (http://repo.hortonworks.com/content/groups/public/org/apache/oozie/oozie-core/) -"

i'm doubting here in this statement "org.apache.oozie:oozie-hbase:jar:0.98.8.oozie-4.0.0" whether my build is trying to search the proper jar.. is this statement was right ? can u help me on this one...

[#4]

@Manikandan Jeyabal

Yes, you should get those errors because in the mentioned repositories the exact oozie-core.4.0.0 version of artifact is not available.

Example: In http://repo.hortonworks.com/content/repositories/releases/org/apache/oozie/oozie-core/ you will find the following version. 4.0.0.2.0.10.0-1

So you will need to change the verison in your "pom.xml" in order to get this unresolved dependency.

[#5]

@ Jay SenSharma tanx for reply,i need a favor from your side, i have attached the modified POM files of my oozie with this reply can u please find and let me know what's the exact mistake that i have done in the files ?

Hadoop-2.5.2

JDK1.7.0_80

Hbase-0.98.8

oozie-4.0.0

pom.xml - main Pom file.

pom.xml - hadoop-2 POM

pom.xml -hadoop-distcp-2

pom.xml - hadoop-test-2

[#6]

coz as you mentioned it should check in the Directory like 4.0.0.2.0.10.0-1 or 4.0.0.2.0.xx.xx-x but it is trying to search for exact oozie-4.0.0, Thinking due to the mistake that i have done in POM.xml files it is referring like that.

[#7]

@Manikandan Jeyabal

Also can you please share your "~/.m2/settings.xml" file?

Or if you are passing any other custom file to define your custom local repository then please share that. Or if you are using any custom settings file as following:

mvn clean install -s /PATH/TO/your/settings.xml

[#8]

@Manikandan Jeyabal

The Blog that you are referring is too Old (2014/08/26): https://gauravkohli.com/2014/08/26/apache-oozie-installation-on-hadoop-2-4-1/

So it is quite possible that those old artiifacts might not be present in the repositories (Maven central). So better get new version of oozie and then try to build it..

If you really want to build oozie then i will suggest you to clone the oozie from here: https://github.com/apache/oozie

# git clone https://github.com/apache/oozie.git

.

[#9]

@Jay SenSharma Tanx for the URL.