- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Sqoop import remaining tables into HDFS
- Labels:
-
Apache Hadoop
-
Apache Sqoop
Created 09-21-2018 02:53 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have a database that contains about 830 tables. I tried doing a sqoop import-all-tables and it imported about 150 tables and failed on one table.
1. Is there a way for me to specify exclusions in the sqoop command?
2. How do I sqoop import the remaining 680 tables? When i use the same sqoop command, it fails as it specifies that some tables are already exisiting?
Here is the sqoop command used:
sqoop import-all-tables --connect "jdbc:sqlserver://192.169.108.64;database=axios; username=sqoop;password=hadoop" --warehouse-dir=/user/Axios -m 1
Created 09-22-2018 10:14 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You can use --exclude-tables <tables>
Option [Comma separated list of tables to exclude from import process] with the sqoop import-all-tables command.
Hope this helps.
Created 09-22-2018 10:14 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You can use --exclude-tables <tables>
Option [Comma separated list of tables to exclude from import process] with the sqoop import-all-tables command.
Hope this helps.
Created 09-24-2018 04:28 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Did the above mentioned property helped in addressing your query? If yes, Could you please login and mark this answer as "Accept" to close this thread.
Created 06-28-2021 01:14 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
But how come one write 150 tables in exclude-tables argument, is there any other alternative for mentioning these many tables in exclude-tables argument.
Created 06-28-2021 10:35 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@harsh8 , as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post.
Regards,
Vidya Sargur,Community Manager
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:
Created 06-28-2021 10:39 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Sure Vidya , Thank you
