Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 10-20-2016 07:21 PM
Do any one help me to write Sqoop script with Java API ?
Created 10-20-2016 07:44 PM
Created 10-20-2016 07:44 PM
Take a look here to start with.
Created 10-20-2016 08:05 PM
Here is an example of using the SQOOP API
https://gist.github.com/umbertogriffo/5ddb75bda34a99a427ff
Just use NIFI, why write a whole Java app?
Or just schedule SQOOP with OOZIE
Created 03-03-2017 05:31 AM
Issue in Sqoop : Oracle database to hdfs
17/03/02 19:44:28 WARN sqoop.ConnFactory: Parameter --driver is set to an explicit driver however appropriate connection manager is not being set (via --connection-manager). Sqoop is going to fall back to org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which connection manager should be used next time.
17/03/02 19:44:28 INFO manager.SqlManager: Using default fetchSize of 1000
17/03/02 19:44:28 INFO tool.CodeGenTool: Beginning code generation
17/03/02 19:44:40 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM ABCSCHEMA.ABCTABLE AS t WHERE 1=0
17/03/02 19:44:40 ERROR manager.SqlManager: Error executing statement: java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not properly ended
java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not properly ended
at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:445)
at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396)
at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:879)
Solution :
1.Table name should be capital :
SqoopOptions.setTableName("ABCSCHEMA.ABCTABLE");
String[] cols={"E_DATE","E_CATEGORY","E_COMPUTER","U_NAME","IPADDRESS","D_NAME","R_INSERT_DATE"};
SqoopOptions.setColumns(cols);
SqoopOptions.setWhereClause("R_INSERT_DATE >=to_date('31-12-1900','DD-MM-YYYY')");
2. Dont Specify Driver name in your program using below commands (refer this : https://issues.apache.org/jira/browse/SQOOP-457 )
So below lines not required in your program :
// SqoopOptions.setDriverClassName(DriverDomain);
//SqoopOptions.setConnManagerClassName("org.apache.sqoop.manager.GenericJdbcManager");
Created 03-03-2017 05:32 AM
Provided solution for "java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not properly ended"