I have a sqoop import job that works fine, reading from MySQL and writing to Parquet. When I execute this from Oozie, it fails, I need to start moving plenty of jars from the sqoop-client/lib folder to the /user/oozie/shared/sqoop/lib or equivalent folder. Kite jars, parquet jars, mysql jars etc etc.
Is this the way to do it? Or am I missing something here?
Yes best to add additional jars to HDFS under ../oozie/lib/share/sqoop/lib
Oozie will load them when launching sqoop commands