I would like to elaborate my requirement here. We have a process that runs on a data set that cleanse it and transforms the data. This process runs in both Staging and Prod individually. We found that there was a data miss match in both the clusters after the job completes. And we wanted to find out the different records that were available in both the clusters. For this purpose I wrote a shell script that will run two beeline queries in the two clusters, generate the output locally and using the shell commands. I, then compare the data and generate a report out of it which is quite a long process. So, I wanted to know if we can compare the two tables from different cluster at the same time with any hive or beeline query.
... View more
