sqoop import when source table contains string with CRLF

marcodiv — Fri, 16 Sep 2022 14:06:50 GMT

Hi all,

I have to import a mysql table into hive environment.

The table has a "notes" column with free text, including the possibility for the user to insert CRLF.

when I try to sqoop import that table, it seems the sqoop command interprets this CRLF as a end of row....

Then everything, from that point on, is not correctly imported: I mean that the CRLF is the end of the row and the first column of the next row in filled in with the "rest" of free text and so on

I use this command:

sqoop import --connect jdbc:mysql://myserver:3306/mydb --username myusername --password mypwd
--table mytable --hive-import --hive-table mytable --hive-database mydb --as-textfile
--warehouse-dir /user/mydb --fields-terminated-by '|' --direct -m 1 --driver com.mysql.jdbc.Driver

Re: sqoop import when source table contains string with CRLF

marcodiv — Fri, 01 Feb 2019 15:03:18 GMT

Hi all, finally found a solution actually it was under my eyes but didn't get soon# I simply added to my sqoop import command the option: --hive-drop-import-delims bye!

question Re: sqoop import when source table contains string with CRLF in Support Questions

sqoop import when source table contains string with CRLF

Re: sqoop import when source table contains string with CRLF