Community Articles

Find and share helpful community-sourced technical articles.
Labels (1)
avatar
Expert Contributor

PROBLEM

Running sqoop import command in direct mode for accessing a Netezza data warehouse appliance hangs at 100% map

sqoop import --options-file sqoop_opts_file.opt
.
.
.
INFO mapreduce.Job: Running job: job_1465914632244_0005
INFO mapreduce.Job: Job job_1465914632244_0005 running in uber mode : false
INFO mapreduce.Job:  map 0% reduce 0%
INFO mapreduce.Job:  map 25% reduce 0%
INFO mapreduce.Job:  map 50% reduce 0%
INFO mapreduce.Job:  map 100% reduce 0%

The sqoop_opts_file.opt had the following options :

-connect
jdbc:netezza://xxxxxxxxxxxxxxxxxxxxxx:5480/
--username
XXXX 
--password
***************
--direct
--direct-split-size
1000000
--compress
--table
table_name
--target-dir
/user/root/table_name
--verbose

Yarn logs show the below errors

ERROR [Thread-14] org.apache.sqoop.mapreduce.db.netezza.NetezzaJDBCStatementRunner: Unable to execute external table export
org.netezza.error.NzSQLException: ERROR:  found delim ',' in a data field, specify escapeChar '\' option in the external table definition
RESOLUTION :

Add --input-escaped-by '\' parameter to sqoop command and then run the command

1,477 Views
0 Kudos