Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Compare Tables between Hive and Oracle
Labels:
- Labels:
-
Apache Hive
Rising Star
Created on ‎04-13-2017 09:07 AM - edited ‎09-16-2022 04:27 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi
Is there a way to compare the whole data of a table in hive and the same table in Oracle?
2 REPLIES 2
Guru
Created ‎04-14-2017 12:45 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Depending on the scale and complexity of table I can think of one of three ways:
- Export the data from Hive and Oracle as CSV file and diff the files
- Use Sqoop to pull the tables from Hive to Oracle or vice versa and write a join query to get the diff
- Programmatically use a simple JDBC client to fetch data from Oracle and Hive and compare
Rising Star
Created ‎04-17-2017 05:04 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
> I have millions of records in each table and hundreds of tables, so first option might not be optimal for big tables.
> will try out the other options
thank you
