Support Questions
Find answers, ask questions, and share your expertise

How to maintain sqoop libs for oozie?

How to maintain sqoop libs for oozie?

I have a sqoop import job that works fine, reading from MySQL and writing to Parquet. When I execute this from Oozie, it fails, I need to start moving plenty of jars from the sqoop-client/lib folder to the /user/oozie/shared/sqoop/lib or equivalent folder. Kite jars, parquet jars, mysql jars etc etc.

Is this the way to do it? Or am I missing something here?

Thanks.

Regards,

David

1 REPLY 1

Re: How to maintain sqoop libs for oozie?

Rising Star

Hi David,

Yes best to add additional jars to HDFS under ../oozie/lib/share/sqoop/lib
Oozie will load them when launching sqoop commands