Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HDP 2.5: Falcon Sqoop Import/Export not working


HDP 2.5: Falcon Sqoop Import/Export not working


I have created read only and write type datasources in Falcon using MySql database Manager.

When I have test the connection in datasource it is success.

Note: I have uploaded the MySQL driver into the Oozie share path as mentioned in the link,


I have created the feed to import but Job action got failed in Oozie,


I have looked into the Yarn log to find the error,

java.lang.RuntimeException: Could not load db driver class: com.mysql.jdbc.Driver at org.apache.sqoop.manager.SqlManager.makeConnection( at org.apache.sqoop.manager.GenericJdbcManager.getConnection( at org.apache.sqoop.manager.SqlManager.execute( at org.apache.sqoop.manager.SqlManager.execute( at org.apache.sqoop.manager.SqlManager.getColumnInfoForRawQuery( at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery( at org.apache.sqoop.manager.SqlManager.getColumnTypes( at org.apache.sqoop.manager.ConnManager.getColumnTypes( at org.apache.sqoop.orm.ClassWriter.getColumnTypes( at org.apache.sqoop.orm.ClassWriter.generate( at org.apache.sqoop.tool.CodeGenTool.generateORM( at org.apache.sqoop.tool.ImportTool.importTable( at at at at org.apache.sqoop.Sqoop.runSqoop( at org.apache.sqoop.Sqoop.runTool( at org.apache.sqoop.Sqoop.runTool( at org.apache.sqoop.Sqoop.main( at org.apache.oozie.action.hadoop.SqoopMain.runSqoopJob( at at at org.apache.oozie.action.hadoop.SqoopMain.main( at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

Found the parameter in YARN log,

Sqoop command arguments : import --connect jdbc:mysql://instance_IP/test --table db_raw_data --username sqoop_user --password sqoop --num-mappers 1 --delete-target-dir --target-dir hdfs://cluster_URI/user/tsldp/falcon/demo/mysql-feed-import-filesystem/2017-01-21-11-00

Driver Jar is not passed as an argument which we have configured for MySQL datasource.

Its looks like,Falcon Sqoop Import and Export won't work from Falcon UI because of this issue.




Re: HDP 2.5: Falcon Sqoop Import/Export not working

New Contributor

@Uvaraj Seerangan Make sure that the oozie sharelib has been updated after adding the MySQL driver

- Update oozie sharelib:

# oozie admin -oozie http://<oozie-server>:11000/oozie -sharelibupdate

- Check that the jar is available for the sqoop action:

# oozie admin -oozie http://<oozie-server>:11000/oozie -shareliblist sqoop*

If there is still an issue, it would be helpful to review the oozie launcher logs and the sqoop action logs to verify the driver was loaded correctly.

Don't have an account?
Coming from Hortonworks? Activate your account here