Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to maintain sqoop libs for oozie?

How to maintain sqoop libs for oozie?

I have a sqoop import job that works fine, reading from MySQL and writing to Parquet. When I execute this from Oozie, it fails, I need to start moving plenty of jars from the sqoop-client/lib folder to the /user/oozie/shared/sqoop/lib or equivalent folder. Kite jars, parquet jars, mysql jars etc etc.

Is this the way to do it? Or am I missing something here?

Thanks.

Regards,

David

1 REPLY 1
Highlighted

Re: How to maintain sqoop libs for oozie?

Rising Star

Hi David,

Yes best to add additional jars to HDFS under ../oozie/lib/share/sqoop/lib
Oozie will load them when launching sqoop commands

Don't have an account?
Coming from Hortonworks? Activate your account here