question Re: Sqoop import remaining tables into HDFS in Archives of Support Questions (Read Only)

Sqoop import remaining tables into HDFS

mswamy — Fri, 21 Sep 2018 21:53:49 GMT

I have a database that contains about 830 tables. I tried doing a sqoop import-all-tables and it imported about 150 tables and failed on one table.

1. Is there a way for me to specify exclusions in the sqoop command?

2. How do I sqoop import the remaining 680 tables? When i use the same sqoop command, it fails as it specifies that some tables are already exisiting?

Here is the sqoop command used:

sqoop import-all-tables --connect "jdbc:sqlserver://192.169.108.64;database=axios; username=sqoop;password=hadoop" --warehouse-dir=/user/Axios -m 1

Re: Sqoop import remaining tables into HDFS

sandyy006 — Sat, 22 Sep 2018 17:14:34 GMT

@Mahadevan Swamy

You can use --exclude-tables <tables> Option [Comma separated list of tables to exclude from import process] with the sqoop import-all-tables command.

Hope this helps.

Re: Sqoop import remaining tables into HDFS

sandyy006 — Mon, 24 Sep 2018 23:28:28 GMT

@Mahadevan Swamy

Did the above mentioned property helped in addressing your query? If yes, Could you please login and mark this answer as "Accept" to close this thread.

Re: Sqoop import remaining tables into HDFS

harsh8 — Mon, 28 Jun 2021 08:14:22 GMT

But how come one write 150 tables in exclude-tables argument, is there any other alternative for mentioning these many tables in exclude-tables argument.

Re: Sqoop import remaining tables into HDFS

VidyaSargur — Mon, 28 Jun 2021 17:35:03 GMT

@harsh8 , as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.

Re: Sqoop import remaining tables into HDFS

harsh8 — Mon, 28 Jun 2021 17:39:16 GMT

Sure Vidya , Thank you