Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created on 03-03-2015 01:39 PM - edited 09-16-2022 02:23 AM
I am getting errors when adding teradata specific connector arguments. What could be the cause ?
Warning: /usr/lib/hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
15/03/03 21:27:35 INFO sqoop.Sqoop: Running Sqoop version: 1.4.3-cdh4.5.0
15/03/03 21:27:35 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
15/03/03 21:27:35 ERROR tool.BaseSqoopTool: Error parsing arguments for import:
15/03/03 21:27:35 ERROR tool.BaseSqoopTool: Unrecognized argument: --input-method
15/03/03 21:27:35 ERROR tool.BaseSqoopTool: Unrecognized argument: split.by.hash
15/03/03 21:27:35 ERROR tool.BaseSqoopTool: Unrecognized argument: --access-lock
sqoop import --connect jdbc:teradata://tdwc/DATABASE=prod\
--username xxx --password 'xxx' \
--table dim_xxx \
--fields-terminated-by '\001'\
--target-dir /user/xxx/exports/prod.diml/20150211/dim_sqoop \
--split-by option_key \
--compress \
--num-mappers 5 \
--input-method split.by.hash\
--access-lock
If i am not including the last 2 lines, it works fine and picks up the sqoop teradata connector
15/03/03 21:27:01 INFO sqoop.Sqoop: Running Sqoop version: 1.4.3-cdh4.5.0
15/03/03 21:27:01 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
15/03/03 21:27:01 INFO teradata.TeradataManagerFactory: Loaded connector factory for 'Cloudera Connector Powered by Teradata' on version 1.3c5
15/03/03 21:27:01 INFO manager.SqlManager: Using default fetchSize of 1000
15/03/03 21:27:01 INFO options.ExtraOptions: Parsing extra arguments
15/03/03 21:27:01 INFO options.OptionsCompatibility: Checking options compatibility
I am using
without cloudera manager.
Thanks in advance,
colin
Created 03-03-2015 05:11 PM
Found my answer myself. Forgot the -- separator between sqoop settings and teradata specific settings. It now works.
-- --input-method split.by.hash \
--access-lock
Created 03-03-2015 05:11 PM
Found my answer myself. Forgot the -- separator between sqoop settings and teradata specific settings. It now works.
-- --input-method split.by.hash \
--access-lock
Created 03-03-2015 10:31 PM