Oozie Shared Lib: where to place jars

jdb — Fri, 16 Sep 2022 09:58:45 GMT

I have installed Cloudera CDH QuickStart VM 5.5, and I'm running a Sqoop action in my Oozie workflow. I encountered an error that says MySQL JDBC driver is missing and I came across to a SO answer that says the mysql-connector-java.jar should be placed in Oozie's HDFS shared lib path, under `sqoop` path.

When I browse the Oozie's HDFS shared lib path, however, I've noticed two `sqoop` subdirectories to copy the jar.

/user/oozie/share/lib/sqoop

and

/user/oozie/share/lib/lib_20151118030154/sqoop

Aside from `sqoop`, `hive`, `pig`, `distcp`, and `mapreduce-streaming` paths also exist on both `lib` and `lib/lib_20151118030154`.

So the question is: where do I place my connector jar: on the first or the second one?

What's the difference (or difference of purpose) of these two paths in relation to jars of `sqoop`, `hive`, `pig`, `distcp`, and `mapreduce-streaming` for Oozie?

Re: Oozie Shared Lib: where to place jars

Harsh J — Thu, 21 Jan 2016 10:25:58 GMT

Use the second one. See
http://blog.cloudera.com/blog/2014/05/how-to-use-the-sharelib-in-apache-oozie-cdh-5/
which
explains the newer timestamped paths.

question Oozie Shared Lib: where to place jars in Archives of Support Questions (Read Only)

Oozie Shared Lib: where to place jars

Re: Oozie Shared Lib: where to place jars