- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Sqoop Extract from HDFS - Primary Key Yes or No
- Labels:
-
Apache Sqoop
-
HDFS
Created on 11-02-2016 09:27 AM - edited 09-16-2022 03:46 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi
I want to export data out of HDFS using Sqoop into a new Teradata table
The Teradata table is yet to be built so we can define it to be the same as the extract we will provide.
My question is when exporting using Sqoop does the table I'm exporting to need to have a primary key defined on it or can I export to a table without one
Thanks
Created on 11-02-2016 07:06 PM - edited 11-02-2016 07:22 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Sqoop export will transfer data to Database using Insert statement as soon the user fires the export command ,Sqoop will connect to database to fetch the metada about the table. The only prequist that pertains to sqoop export command is that (--table parameter) table must exist prior to runining sqoop. You can have the table with primary key or not is up to your design . The user have to make sure that there not be any constraint violations while performing the Sqoop export(i,e INSERT)
Created on 11-02-2016 07:06 PM - edited 11-02-2016 07:22 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Sqoop export will transfer data to Database using Insert statement as soon the user fires the export command ,Sqoop will connect to database to fetch the metada about the table. The only prequist that pertains to sqoop export command is that (--table parameter) table must exist prior to runining sqoop. You can have the table with primary key or not is up to your design . The user have to make sure that there not be any constraint violations while performing the Sqoop export(i,e INSERT)
