Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Compare Tables between Hive and Oracle

avatar
Rising Star

Hi

Is there a way to compare the whole data of a table in hive and the same table in Oracle?

2 REPLIES 2

avatar

Depending on the scale and complexity of table I can think of one of three ways:

  1. Export the data from Hive and Oracle as CSV file and diff the files
  2. Use Sqoop to pull the tables from Hive to Oracle or vice versa and write a join query to get the diff
  3. Programmatically use a simple JDBC client to fetch data from Oracle and Hive and compare

avatar
Rising Star

> I have millions of records in each table and hundreds of tables, so first option might not be optimal for big tables.

> will try out the other options

thank you