Hi,
When I run below sqoop command with -num-mapper 10, while it succeeeds when -num-mappers is set 1; kindly suggest, how to run the command with -num-mapper 10.
driver=com.sybase.jdbc4.jdbc.SybDriver
echo "${driver}"
jconnect=jdbc:sybase:Tds:USD01V-SYIQ003:7777/DATABASE=JFORSDEV
echo "${jconnect}"
sqoop export \
-Dsqoop.export.statements.per.transaction=1000 \
-verbose \
-driver "${driver}" \
-connect "${jconnect}" \
-username=tableau \
-password=Smile123 \
-direct \
-export-dir '/tmp/test' \
-input-lines-terminated-by '\n' \
-input-optionally-enclosed-by '\"' \
-fields-terminated-by '\t' \
-table tableau.sqoopExport_orc \
-columns 'id,first_name,last_name,address' \
-batch \
-num-mappers 10 \
;
Sqoop export does partial export and fails with error
2018-06-08 04:17:19,385 FATAL [IPC Server handler 11 on 37311] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1528413303562_0066_m_000005_0 - exited : java.io.IOException: java.sql.BatchUpdateException: JZ0BE: BatchUpdateException: Error occurred while executing batch statement: SQL Anywhere Error -210: User 'another user' has the row in 'sqoopExport_orc' locked
at org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.close(AsyncSqlRecordWriter.java:205)
at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:670)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
