I can confirm what
@Josh Persinger is saying. The only way to get tables with forward slashes ('/') (and actually colons too) in the tablename from SAP into hadoop hdfs/hive is by using the --query statement.
Some other things I found out when importing from SAP HANA:
- a table name can be something like 'MSG\TABLENAME' or even worse: '[SCHEMA]::database.[TABLENAME]'. Just make sure you put the complete tablename between escaped double quotes:
eg:
\"/SOMETING/TABLENAME\" or \"[SCHEMA]::database.[TABLENAME]\"
- we needed to add there where clause '\$CONDITIONS' even though we did a select * without any filters.
- when limiting the result with a where clause the values have to be between single quotes:
eg. WHERE DDLANGUAGE='E'
- SAP columns can contain empty values called SPACE (not the same as NULL) (shown as a '?' in the webIDE). If you want to exclude them use the where clause <>'' (just two singlequotes following each other):
WHERE DDLANGUAGE<>''
- When making your command more readible I had to keep one extra parameter after the --query parameter. When I moved the --hive-import to the next line the command would fail (I think due to the ending quotes of the query.
The result should look something like this:
sqoop import --connect "jdbc:sap://[SERVER]:30015/?currentschema=[SCHEMA]" \
--username [USERNAME] \
--password-file file:///[PATH]/.pwd_file \
--driver com.sap.db.jdbc.Driver \
--query "select * from \"[/TABLENAME/WITH/FORWARDSLASHES]\" WHERE DDLANGUAGE='E' and [COLUMNNAME]<>'' and \$CONDITIONS" --hive-import \
--hive-database [HIVEDATABASE] \
--hive-table [TABLENAME] \
--hive-delims-replacement ' ' \
--fields-terminated-by '|' \
--lines-terminated-by '\n' \
--hive-overwrite
--num-mappers 1
