Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Solved
Go to solution
does sharelib jars needs to be explicitly included in java action in <file>?
Labels:
- Labels:
-
Apache Oozie
New Contributor
Created on ‎02-15-2019 03:26 AM - edited ‎09-16-2022 07:09 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
does sharelib jars like
- hive-exec
- hive-common
- hive-jdbc
- hive-serivce
- libthrift
needs to be included explicitly in java action <file> tag or those are auto included?
From this document i see they should be auto included if i am not wrong? how-to-use-the-sharelib-in-apache-oozie-cdh-5
1 ACCEPTED SOLUTION
Mentor
Created ‎02-15-2019 07:13 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The share-lib in Oozie is modular, so it only adds necessary jars for each
action type. The java action is the most generic of all action types, and
therefore receives none of the other action type dependencies (such as
hive, pig, distcp, spark, etc.).
The article you've linked to carries an answer to the question of 'how do I
further include jars from action type X into my action type Y', which I've
quoted below for convenience:
"""
For example, if you want all Pig actions in one of your Workflows to
include the HCatalog ShareLib, you would add
oozie.action.sharelib.for.pig=pig,hcatalog to your job.properties.
"""
So in your case, you may want to try and add:
oozie.action.sharelib.for.java=java,hive
action type. The java action is the most generic of all action types, and
therefore receives none of the other action type dependencies (such as
hive, pig, distcp, spark, etc.).
The article you've linked to carries an answer to the question of 'how do I
further include jars from action type X into my action type Y', which I've
quoted below for convenience:
"""
For example, if you want all Pig actions in one of your Workflows to
include the HCatalog ShareLib, you would add
oozie.action.sharelib.for.pig=pig,hcatalog to your job.properties.
"""
So in your case, you may want to try and add:
oozie.action.sharelib.for.java=java,hive
1 REPLY 1
Mentor
Created ‎02-15-2019 07:13 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The share-lib in Oozie is modular, so it only adds necessary jars for each
action type. The java action is the most generic of all action types, and
therefore receives none of the other action type dependencies (such as
hive, pig, distcp, spark, etc.).
The article you've linked to carries an answer to the question of 'how do I
further include jars from action type X into my action type Y', which I've
quoted below for convenience:
"""
For example, if you want all Pig actions in one of your Workflows to
include the HCatalog ShareLib, you would add
oozie.action.sharelib.for.pig=pig,hcatalog to your job.properties.
"""
So in your case, you may want to try and add:
oozie.action.sharelib.for.java=java,hive
action type. The java action is the most generic of all action types, and
therefore receives none of the other action type dependencies (such as
hive, pig, distcp, spark, etc.).
The article you've linked to carries an answer to the question of 'how do I
further include jars from action type X into my action type Y', which I've
quoted below for convenience:
"""
For example, if you want all Pig actions in one of your Workflows to
include the HCatalog ShareLib, you would add
oozie.action.sharelib.for.pig=pig,hcatalog to your job.properties.
"""
So in your case, you may want to try and add:
oozie.action.sharelib.for.java=java,hive
