Hi,
I am trying to do incremental last modified using sqoop
sqoop job --create IncrementalImport \
-- import \
--connect 'jdbc:sqlserver://servername;username=xxxxx;password=xxxx;database=xxxx' \
--driver "com.microsoft.sqlserver.jdbc.SQLServerDriver" \
--table table_name \
--target-dir /dir_name \
--incremental lastmodified \
--check-column date \
--merge-key primary_key_column \
-m 1
I am getting the issue when executing the sqoop job --exec IncrementalImport
Warning: /usr/hdp/2.6.5.0-292/accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
Picked up JAVA_TOOL_OPTIONS: -Xmx1024m -Djava.io.tmpdir=/h/tmp
18/10/24 08:27:40 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.6.5.0-292
ssound13@hpchdd2e:~> sqoop job --exec IncrementalImportLastModified
Warning: /usr/hdp/2.6.5.0-292/accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
Picked up JAVA_TOOL_OPTIONS: -Xmx1024m -Djava.io.tmpdir=/h/tmp
18/10/24 08:27:57 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.6.5.0-292
18/10/24 08:27:58 WARN sqoop.ConnFactory: Parameter --driver is set to an explicit driver however appropriate connection manager is not being set (via --connection-manager). Sqoop is going to fall back to org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which connection manager should be used next time.
18/10/24 08:27:58 INFO manager.SqlManager: Using default fetchSize of 1000
18/10/24 08:27:58 INFO tool.CodeGenTool: Beginning code generation
18/10/24 08:27:59 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM table_name AS t WHERE 1=0
18/10/24 08:27:59 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM table_name AS t WHERE 1=0
18/10/24 08:27:59 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/hdp/2.6.5.0-292/hadoop-mapreduce
Note: /tmp/sqoop-ssound13/compile/48dc5192c1b8869fb61635da887c3aa0/table_name.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
18/10/24 08:28:00 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-ssound13/compile/48dc5192c1b8869fb61635da887c3aa0/Attrib_Type.jar
18/10/24 08:28:01 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM table_name AS t WHERE 1=0
18/10/24 08:28:01 ERROR manager.SqlManager: SQL exception accessing current timestamp: com.microsoft.sqlserver.jdbc.SQLServerException: Incorrect syntax near ')'.
com.microsoft.sqlserver.jdbc.SQLServerException: Incorrect syntax near ')'.
at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:216)
at com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1515)
at com.microsoft.sqlserver.jdbc.SQLServerStatement.doExecuteStatement(SQLServerStatement.java:792)
at com.microsoft.sqlserver.jdbc.SQLServerStatement$StmtExecCmd.doExecute(SQLServerStatement.java:689)
at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:5696)
at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:1715)
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:180)
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:155)
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeQuery(SQLServerStatement.java:616)
at org.apache.sqoop.manager.SqlManager.getCurrentDbTimestamp(SqlManager.java:987)
at org.apache.sqoop.tool.ImportTool.initIncrementalConstraints(ImportTool.java:328)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:498)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:615)
at org.apache.sqoop.tool.JobTool.execJob(JobTool.java:243)
at org.apache.sqoop.tool.JobTool.run(JobTool.java:298)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:225)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
at org.apache.sqoop.Sqoop.main(Sqoop.java:243)
18/10/24 08:28:01 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Could not get current time from database
at org.apache.sqoop.tool.ImportTool.initIncrementalConstraints(ImportTool.java:330)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:498)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:615)
at org.apache.sqoop.tool.JobTool.execJob(JobTool.java:243)
at org.apache.sqoop.tool.JobTool.run(JobTool.java:298)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:225)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
at org.apache.sqoop.Sqoop.main(Sqoop.java:243)
can anyone please help reg the issue
in the sql server the last modified column has datatype as datetime - yyyy-mm-dd 00:00:000.0000
