I have two tables in Hive. table 1 keeps getting new data. I want table 2 to be refreshed with data from table 1 at regular intervals - say every 10 minutes.
Whats the best way to do this?
And no - I cannot use the data source of table 1 to write into table 2. I need a separate mechanism for this.
Appreciate the insights.
Have you considered SQL Merge statement?