question Re: Sqoop Import-all-tables not working with target-dir option. in Support Questions

Sqoop Import-all-tables not working with target-dir option.

rmy1712 — Wed, 16 Aug 2017 06:23:49 GMT

While trying to use import-all-tables if i specify the target-dir , i'm getting the below error.

$ sqoop import-all-tables --connect jdbc:mysql://localhost/db --username root --target-dir 'alltables/data' -m 1 

17/08/14 14:08:07 ERROR tool.BaseSqoopTool: Error parsing arguments for import-all-tables:

17/08/14 14:08:07 ERROR tool.BaseSqoopTool: Unrecognized argument: --target-dir 

17/08/14 14:08:07 ERROR tool.BaseSqoopTool: Unrecognized argument: alltables/data 

17/08/14 14:08:07 ERROR tool.BaseSqoopTool: Unrecognized argument: -m 

17/08/14 14:08:07 ERROR tool.BaseSqoopTool: Unrecognized argument: 1

Appreciate any help.!!

Re: Sqoop Import-all-tables not working with target-dir option.

dineshc — Wed, 16 Aug 2017 06:26:02 GMT

@Ramya

Please follow this official documentation of Sqoop.

--target-dir is not a valid option when using import-all-tables. Thus you cannot use this.

Re: Sqoop Import-all-tables not working with target-dir option.

AndresUrrego — Wed, 16 Aug 2017 23:00:06 GMT

Checking the official documentation link here. they suggest that each table will create automatically a separate folder for the outcome to store the data in the default HDFS path for the user who perform the operation.

$ sqoop import-all-tables --connect jdbc:mysql://db.foo.com/corp

$ hadoop fs -ls
Found 4 items
drwxr-xr-x   - someuser somegrp       0 2010-04-27 17:15 /user/someuser/EMPLOYEES
drwxr-xr-x   - someuser somegrp       0 2010-04-27 17:15 /user/someuser/PAYCHECKS
drwxr-xr-x   - someuser somegrp       0 2010-04-27 17:15 /user/someuser/DEPARTMENTS
drwxr-xr-x   - someuser somegrp       0 2010-04-27 17:15 /user/someuser/OFFICE_SUPPLIES

Re: Sqoop Import-all-tables not working with target-dir option.

rmy1712 — Thu, 17 Aug 2017 00:12:23 GMT

@Andres Urrego

Thank you..!!

Yes. But when we are using only 'Import' instead of 'Import-all-tables', we can specify where to store the table, instead of the default HDFS path using --target-dir .

As per below code, the data is imported to the target directory specified.

sqoop import --connect jdbc:mysql://localhost/my_db --table EMP --username root --target-dir 'sqoopdata/emp' -m 1

Re: Sqoop Import-all-tables not working with target-dir option.

AndresUrrego — Thu, 17 Aug 2017 00:39:43 GMT

yes exactly you right but this is only in import as --export-dir for export operation 🙂 this how that works

Re: Sqoop Import-all-tables not working with target-dir option.

rockstar_nandis — Tue, 22 Aug 2017 11:20:56 GMT

Hi Ramya

To import all tables in particular directory, Use --warehouse-dir <directory> instead of --target-dir <directory>

example:

sqoop import --connect jdbc:mysql://localhost/test --table test1 --username xxxxx -P --warehouse-dir /home/user/Desktop/sqoopdump -m 1

Re: Sqoop Import-all-tables not working with target-dir option.

rmy1712 — Tue, 29 Aug 2017 02:49:30 GMT

Thank you @Nandish B Naidu..!!

The solution worked.