Support Questions
Find answers, ask questions, and share your expertise

Hive Table Repair In Cluster Not Reflecting In Another Cluster

Contributor

Hello,

We have a requirement where two of our clusters is sharing the same Hive metastore. We are storing the data in S3.

Due to some requirement we had to move the S3 buckets. After this we repaired the tables in one cluster and everything is running fine. On the other cluster we did not repair the tables assuming that running on the first cluster should be fine.

But on the second cluster the queries are throwing error as "S3 path does not exist".

So, is it not sufficient to repair the tables from one cluster which updates the hive metastore? Is it required to repair the same tables from other cluster as well?

1 REPLY 1

Re: Hive Table Repair In Cluster Not Reflecting In Another Cluster

Rising Star

As a best practicce , we should separate the Hive Metastore in 2 different clusters, now if it's a requirement then fine.

The repair should work in both assuming your S3 buckets are shared as well .. and accessible.

To chek your repair has worked in both cluster, check with the following command

<code>SELECT * FROM METASTOREDB.XXX
  WHERE TABNAME = 'YOUR TABLE';