Support Questions

Find answers, ask questions, and share your expertise

Compare Tables between Hive and Oracle

avatar
Rising Star

Hi

Is there a way to compare the whole data of a table in hive and the same table in Oracle?

2 REPLIES 2

avatar

Depending on the scale and complexity of table I can think of one of three ways:

  1. Export the data from Hive and Oracle as CSV file and diff the files
  2. Use Sqoop to pull the tables from Hive to Oracle or vice versa and write a join query to get the diff
  3. Programmatically use a simple JDBC client to fetch data from Oracle and Hive and compare

avatar
Rising Star

> I have millions of records in each table and hundreds of tables, so first option might not be optimal for big tables.

> will try out the other options

thank you