question Sqoop Netezza connector syntax for --ctrl-chars --trunc-string in Archives of Support Questions (Read Only)

Sqoop Netezza connector syntax for --ctrl-chars --trunc-string

rajesh_devabhak — Wed, 05 Apr 2017 02:54:07 GMT

Hi I am trying to run sqoop command with options --ctrl-chars  --trunc-string
I am getting an errors saying 

17/04/04 14:23:09 ERROR tool.BaseSqoopTool: Error parsing arguments for export:
17/04/04 14:23:09 ERROR tool.BaseSqoopTool: Unrecognized argument: -ctrl-chars
17/04/04 14:23:09 ERROR tool.BaseSqoopTool: Unrecognized argument: -trunc-string
17/04/04 14:23:09 ERROR tool.BaseSqoopTool: Unrecognized argument: -max-errors

Sqoop version 1.4.6.2.5.3.0-37
Hortonworks HDP 2.5.3


My sqoop command is as below.

sqoop-export \
 -Dmapreduce.job.queuename=analyst \
 -Dmapreduce.job.name=web_event.sqp \
 --direct \
 --connect jdbc:netezza://fdhgfgjhkj:5480/dghnfgjhnfgj \
 --table fgjhfgjj \
 --username rjrjtru \
 -P \
 --export-dir /dataset-ste/secure-p/inbound/rtujrjryiutydidti/ \
 --input-escaped-by '\\' \
 --input-fields-terminated-by '\t' \
 --input-lines-terminated-by '\n' \
 --input-null-string '\\N' \
 --input-null-non-string '\\N' \
 -m 4 \
 --verbose \
 --ctrl-chars 
 --trunc-string 
 -max-errors #0

Re: Sqoop Netezza connector syntax for --ctrl-chars --trunc-string

srai1 — Wed, 05 Apr 2017 10:30:10 GMT

@Rajesh Babu Devabhaktuni

Try stripping the command and use less options. Try and break it in to chunks to see where the problem is.

Re: Sqoop Netezza connector syntax for --ctrl-chars --trunc-string

namaheshwari — Wed, 05 Apr 2017 10:46:09 GMT

Below stackoverflow post talks about similar issue:

http://stackoverflow.com/questions/25770698/sqoop-free-form-query-causing-unrecognized-arguments-in-hue-oozie

Re: Sqoop Netezza connector syntax for --ctrl-chars --trunc-string

bolisettysunil — Wed, 05 Apr 2017 21:49:18 GMT

Netezza driver with direct mode would support --ctrl-chars option. Please make sure to use this option with preceeding --, like sqoop import --direct --connect jdbc:netezza://<netezza_host>:5480/db --username user -P --table table --targe-dir hdfsdir \ – --ctrl-chars --crin-string --ignore-zero --trunc-string options

Re: Sqoop Netezza connector syntax for --ctrl-chars --trunc-string

rajesh_devabhak — Wed, 05 Apr 2017 21:53:10 GMT

This works
sqoop-export \
-Dmapreduce.job.queuename=analyst \
-Dmapreduce.job.name=web_event.sqp \
--direct \
--connect jdbc:netezza://fdhgfgjhkj:5480/dghnfgjhnfgj \
--table fgjhfgjj \
--username rjrjtru \
-P \
--export-dir /dataset-ste/secure-p/inbound/rtujrjryiutydidti/ \
--input-escaped-by'\\' \
--input-fields-terminated-by'\t' \
--input-lines-terminated-by'\n' \
--input-null-string'\\N' \
--input-null-non-string'\\N' \
-m 4 \
--verbose \
-- \
--ctrl-chars \
--trunc-string \
-max-errors 20