Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

does sharelib jars needs to be explicitly included in java action in <file>?

avatar
New Contributor

does sharelib jars like 

  1. hive-exec
  2. hive-common
  3. hive-jdbc
  4. hive-serivce
  5. libthrift

needs to be included explicitly in java action <file> tag or those are auto included?

From this document i see they should be auto included if i am not wrong? how-to-use-the-sharelib-in-apache-oozie-cdh-5

 

1 ACCEPTED SOLUTION

avatar
Mentor
The share-lib in Oozie is modular, so it only adds necessary jars for each
action type. The java action is the most generic of all action types, and
therefore receives none of the other action type dependencies (such as
hive, pig, distcp, spark, etc.).

The article you've linked to carries an answer to the question of 'how do I
further include jars from action type X into my action type Y', which I've
quoted below for convenience:

"""
For example, if you want all Pig actions in one of your Workflows to
include the HCatalog ShareLib, you would add
oozie.action.sharelib.for.pig=pig,hcatalog to your job.properties.
"""

So in your case, you may want to try and add:

oozie.action.sharelib.for.java=java,hive

View solution in original post

1 REPLY 1

avatar
Mentor
The share-lib in Oozie is modular, so it only adds necessary jars for each
action type. The java action is the most generic of all action types, and
therefore receives none of the other action type dependencies (such as
hive, pig, distcp, spark, etc.).

The article you've linked to carries an answer to the question of 'how do I
further include jars from action type X into my action type Y', which I've
quoted below for convenience:

"""
For example, if you want all Pig actions in one of your Workflows to
include the HCatalog ShareLib, you would add
oozie.action.sharelib.for.pig=pig,hcatalog to your job.properties.
"""

So in your case, you may want to try and add:

oozie.action.sharelib.for.java=java,hive