- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
incorrect data,post sqoop from MS-SQL to Hadoop
Created on ‎03-03-2019 11:57 PM - edited ‎09-16-2022 07:12 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi All,
We have sqooped data from MS-SQL 2008 into HDFS and created external tables . The record count shows same between the MS-SQL table and Hive tables. However, if i fire same query on MS-SQL table and Hive table, the output is different. The query is being fired through Hue(tested through Impala as well). Could you please help, if i missed something?
Regards.
Sandeep Suman
Created on ‎03-05-2019 07:25 AM - edited ‎03-05-2019 07:25 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Sandeep,
It seems the data has been imported as the count is same. But sometimes the datatype might be different between MS-SQL and Hive tables which result in NULL values.
Let's try to check the datatype between the tables and also share the sqoop command for further check
Thanks
Jerry
Created on ‎03-05-2019 07:25 AM - edited ‎03-05-2019 07:25 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Sandeep,
It seems the data has been imported as the count is same. But sometimes the datatype might be different between MS-SQL and Hive tables which result in NULL values.
Let's try to check the datatype between the tables and also share the sqoop command for further check
Thanks
Jerry
Created ‎03-05-2019 07:15 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks for your help. Few columns had different data types and table was created using delimiter ',' and column data had elements with '','.
Regards.
Sandeep Suman
