Support Questions

Find answers, ask questions, and share your expertise

Oozie Shared Lib: where to place jars

avatar
Contributor

I have installed Cloudera CDH QuickStart VM 5.5, and I'm running a Sqoop action in my Oozie workflow. I encountered an error that says MySQL JDBC driver is missing and I came across to a SO answer that says the mysql-connector-java.jar should be placed in Oozie's HDFS shared lib path, under `sqoop` path.

When I browse the Oozie's HDFS shared lib path, however, I've noticed two `sqoop` subdirectories to copy the jar.

/user/oozie/share/lib/sqoop


and

  

/user/oozie/share/lib/lib_20151118030154/sqoop


Aside from `sqoop`, `hive`, `pig`, `distcp`, and `mapreduce-streaming` paths also exist on both `lib` and `lib/lib_20151118030154`.

So the question is: where do I place my connector jar: on the first or the second one?

What's the difference (or difference of purpose) of these two paths in relation to jars of `sqoop`, `hive`, `pig`, `distcp`, and `mapreduce-streaming` for Oozie?

 

1 ACCEPTED SOLUTION

avatar
Mentor
1 REPLY 1

avatar
Mentor
Use the second one. See
http://blog.cloudera.com/blog/2014/05/how-to-use-the-sharelib-in-apache-oozie-cdh-5/
which
explains the newer timestamped paths.