- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Sqoop import data from Teradata to HDP as default file format as deflate... why?
Created on ‎04-14-2016 03:53 PM - edited ‎09-16-2022 03:13 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Using HDP-2.3.4.0. Importing data from Teradata to HDP using sqoop import command. The default extension it is given in HDP as .deflate. Why?
thanks,
Mugdha
Created ‎04-14-2016 04:27 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
By default Sqoop doesn't compress your output data, are you by chance using gzip compression? Is this only happening with teradata imports?
Created ‎04-14-2016 04:27 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
By default Sqoop doesn't compress your output data, are you by chance using gzip compression? Is this only happening with teradata imports?
Created ‎04-14-2016 05:04 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I won't use any compression in the Sqoop command. Still it store it as .deflate format. This is only happening with Teradata as I am using Teradata connector for HDP 2.3.4.0.
