Skip to main content
krajguru
Gold ⭐️
December 22, 2016

Sqoop import for Netezza connector in direct mode hangs

  • October 5, 2026 at 9:32 AM
  • 0 replies
  • 1853 views
  • Translate All

PROBLEM

Running sqoop import command in direct mode for accessing a Netezza data warehouse appliance hangs at 100% map

sqoop import --options-file sqoop_opts_file.opt
.
.
.
INFO mapreduce.Job: Running job: job_1465914632244_0005
INFO mapreduce.Job: Job job_1465914632244_0005 running in uber mode : false
INFO mapreduce.Job: map 0% reduce 0%
INFO mapreduce.Job: map 25% reduce 0%
INFO mapreduce.Job: map 50% reduce 0%
INFO mapreduce.Job: map 100% reduce 0%

The sqoop_opts_file.opt had the following options :

-connect
jdbc:netezza://xxxxxxxxxxxxxxxxxxxxxx:5480/
--username
XXXX
--password
***************
--direct
--direct-split-size
1000000
--compress
--table
table_name
--target-dir
/user/root/table_name
--verbose

Yarn logs show the below errors

ERROR [Thread-14] org.apache.sqoop.mapreduce.db.netezza.NetezzaJDBCStatementRunner: Unable to execute external table export
org.netezza.error.NzSQLException: ERROR: found delim ',' in a data field, specify escapeChar '\' option in the external table definition

RESOLUTION :

Add --input-escaped-by '\' parameter to sqoop command and then run the command