Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

sqoop export errors out after running for a while. Re-running it once or twice will succeed.

sqoop export errors out after running for a while. Re-running it once or twice will succeed.

New Contributor

I am running sqoop export to Oracle and it fails intermittently after doing like 25% or 60% or so. If I re-run it after truncating the table, it will succeed in a few attempts. I have increased the timeout to 6000 seconds and still face this issue intermittently. Pl. help.

sqoop export -D mapred.task.timeout=30000000 \ --connect $connect_string \ --table $table_name \ --username $user_id \ --password $pass \ --direct \ --hcatalog-database abc \ --hcatalog-table xyz

1 REPLY 1

Re: sqoop export errors out after running for a while. Re-running it once or twice will succeed.

New Contributor

The below is the error I was able to capture from yarn logs..

2018-10-25 14:09:57,101 INFO [IPC Server handler 12 on 29533] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1539827502156_606793_m_000002_0 is : 0.13415413 2018-10-25 14:09:58,046 INFO [IPC Server handler 12 on 29533] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1539827502156_606793_m_000001_0 is : 0.9945328 2018-10-25 14:09:58,693 INFO [IPC Server handler 27 on 29533] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1539827502156_606793_m_000000_0 is : 0.0 2018-10-25 14:09:58,698 FATAL [IPC Server handler 28 on 29533] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1539827502156_606793_m_000000_0 - exited : java.io.IOException: java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish the connection at org.apache.sqoop.mapreduce.ExportBatchOutputFormat.getRecordWriter(ExportBatchOutputFormat.java:50) at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.<init>(MapTask.java:647) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:767) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164) Caused by: java.sql.SQLRecoverableException: IO Error: The Network Adapter could not establish the connection