- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Sqoop Netezza connector syntax for --ctrl-chars --trunc-string
- Labels:
-
Apache Hadoop
-
Apache Sqoop
Created ‎04-04-2017 07:54 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi I am trying to run sqoop command with options --ctrl-chars --trunc-string I am getting an errors saying 17/04/04 14:23:09 ERROR tool.BaseSqoopTool: Error parsing arguments for export: 17/04/04 14:23:09 ERROR tool.BaseSqoopTool: Unrecognized argument: -ctrl-chars 17/04/04 14:23:09 ERROR tool.BaseSqoopTool: Unrecognized argument: -trunc-string 17/04/04 14:23:09 ERROR tool.BaseSqoopTool: Unrecognized argument: -max-errors Sqoop version 1.4.6.2.5.3.0-37 Hortonworks HDP 2.5.3 My sqoop command is as below. sqoop-export \ -Dmapreduce.job.queuename=analyst \ -Dmapreduce.job.name=web_event.sqp \ --direct \ --connect jdbc:netezza://fdhgfgjhkj:5480/dghnfgjhnfgj \ --table fgjhfgjj \ --username rjrjtru \ -P \ --export-dir /dataset-ste/secure-p/inbound/rtujrjryiutydidti/ \ --input-escaped-by '\\' \ --input-fields-terminated-by '\t' \ --input-lines-terminated-by '\n' \ --input-null-string '\\N' \ --input-null-non-string '\\N' \ -m 4 \ --verbose \ --ctrl-chars --trunc-string -max-errors #0
Created ‎04-05-2017 02:49 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Netezza driver with direct mode would support --ctrl-chars option. Please make sure to use this option with preceeding --, like sqoop import --direct --connect jdbc:netezza://<netezza_host>:5480/db --username user -P --table table --targe-dir hdfsdir \ – --ctrl-chars --crin-string --ignore-zero --trunc-string options
Created ‎04-05-2017 03:30 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Try stripping the command and use less options. Try and break it in to chunks to see where the problem is.
Created ‎04-05-2017 03:46 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Below stackoverflow post talks about similar issue:
Created ‎04-05-2017 02:49 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Netezza driver with direct mode would support --ctrl-chars option. Please make sure to use this option with preceeding --, like sqoop import --direct --connect jdbc:netezza://<netezza_host>:5480/db --username user -P --table table --targe-dir hdfsdir \ – --ctrl-chars --crin-string --ignore-zero --trunc-string options
Created ‎04-05-2017 02:53 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
- This works
- sqoop-export \
- -Dmapreduce.job.queuename=analyst \
- -Dmapreduce.job.name=web_event.sqp \
- --direct \
- --connect jdbc:netezza://fdhgfgjhkj:5480/dghnfgjhnfgj \
- --table fgjhfgjj \
- --username rjrjtru \
- -P \
- --export-dir /dataset-ste/secure-p/inbound/rtujrjryiutydidti/ \
- --input-escaped-by'\\' \
- --input-fields-terminated-by'\t' \
- --input-lines-terminated-by'\n' \
- --input-null-string'\\N' \
- --input-null-non-string'\\N' \
- -m 4 \
- --verbose \
- -- \
- --ctrl-chars \
- --trunc-string \
- -max-errors 20
