https://community.cloudera.com/t5/Archives-of-Support-Questions/merge-two-big-tables-from-SQLSERVER-for-Sqoop-Import/m-p/115100#M33960 <P>I run into an issue when I try to merge two big tables from SQLSERVER for Sqoop to Import. I’m getting SQL exception error of rows reached its maximum limit. Please read below error message for more details. Please share your thoughts/suggestions, if you have faced it before.</P><P>Error: java.io.IOException: Cannection handler cannot recover failure: at org.apache.sqoop.mapreduce.db.SQLServerDBRecordReader.nextKeyValue(SQLServerDBRecordReader.java:169) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:553) at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80) at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) Caused by: java.io.IOException: SQLException in nextKeyValue </P> Wed, 06 Jul 2016 13:14:31 GMT prashantkotkar2 2016-07-06T13:14:31Z https://community.cloudera.com/t5/Archives-of-Support-Questions/merge-two-big-tables-from-SQLSERVER-for-Sqoop-Import/m-p/115100#M33960 <P>I run into an issue when I try to merge two big tables from SQLSERVER for Sqoop to Import. I’m getting SQL exception error of rows reached its maximum limit. Please read below error message for more details. Please share your thoughts/suggestions, if you have faced it before.</P><P>Error: java.io.IOException: Cannection handler cannot recover failure: at org.apache.sqoop.mapreduce.db.SQLServerDBRecordReader.nextKeyValue(SQLServerDBRecordReader.java:169) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:553) at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80) at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) Caused by: java.io.IOException: SQLException in nextKeyValue </P> Wed, 06 Jul 2016 13:14:31 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/merge-two-big-tables-from-SQLSERVER-for-Sqoop-Import/m-p/115100#M33960 prashantkotkar2 2016-07-06T13:14:31Z https://community.cloudera.com/t5/Archives-of-Support-Questions/merge-two-big-tables-from-SQLSERVER-for-Sqoop-Import/m-p/115101#M33961 <P>SQL Server’s limit on the row size is applicable even when you join 2 tables and select a big row.</P><P>Alternative solution if you dont want to change row size is you can Import the sqlserver tables into Hadoop as individual external tables. Then join them in the Hadoop side and populate actual table.</P> Wed, 06 Jul 2016 13:19:29 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/merge-two-big-tables-from-SQLSERVER-for-Sqoop-Import/m-p/115101#M33961 mkumar13 2016-07-06T13:19:29Z https://community.cloudera.com/t5/Archives-of-Support-Questions/merge-two-big-tables-from-SQLSERVER-for-Sqoop-Import/m-p/115102#M33962 <P>thanks for reply, i can do that in my use case. Let me try!</P> Wed, 06 Jul 2016 13:25:26 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/merge-two-big-tables-from-SQLSERVER-for-Sqoop-Import/m-p/115102#M33962 prashantkotkar2 2016-07-06T13:25:26Z