question Re: Import Sqoop as textfile in Archives of Support Questions (Read Only)

Import Sqoop as textfile

AndresUrrego — Mon, 15 May 2017 23:43:54 GMT

Hey everyone,

I'm new in Sqoop I'm trying to import from MySQL to a text file using a query , my sqoop command is:

sqoop import --connect jdbc:mysql://master/poc --username root --query 'SELECT * FROM table WHERE $CONDITIONS' --split-by field --target-dir /user/hdfs/mysql --as-textfile -m 1;

The problem is that , when y job finish i run hdfs dfs -ls /user/hdfs/mysql and i see just the file success and the part* but any txt so, I dont know what i'm missing. can some one give me a hand to complete my statement.

thanks so much

Re: Import Sqoop as textfile

balavignesh_nag — Tue, 16 May 2017 00:01:07 GMT

Hi @Andres Urrego

Are you able to see any other files which starts with part_m_* in that folder? Those are the text files which you have imported from MySQL

Re: Import Sqoop as textfile

AndresUrrego — Tue, 16 May 2017 00:35:28 GMT

Hi buddy yes actually i got a file part-m-00000, then when i perform a -cat i get the results from my query but so that means that i will never get a .txt so is just convert this part to txt extention? thanks

Re: Import Sqoop as textfile

AndresUrrego — Tue, 16 May 2017 01:06:21 GMT

Actually guys i have realized in Sqoop documentation that this output file is the default so yeah this is the txt form. thanks so much. I'm going to close this thread. official info here https://sqoop.apache.org/docs/1.4.1-incubating/SqoopUserGuide.html

Re: Import Sqoop as textfile

andrew_zhou — Sat, 27 Oct 2018 00:41:18 GMT

Hi Andres,

Is your -cat result plain text? I'm getting un-readble characters. Hope you can share some info to correct my import command.

Thanks,

Andrew

Re: Import Sqoop as textfile

andrew_zhou — Wed, 07 Nov 2018 07:06:07 GMT

@Andres Urrego

Can you cat the output file?