question Re: Configure HA database for Hive Metastore in Support Questions

Configure HA database for Hive Metastore

KPG1 — Mon, 14 Nov 2022 08:32:08 GMT

We have an MYSQL HA cluster,

In case of failover, for the secondary master to take the place of the failed master, the hive metastore connection string configuration would need to be changed to point to the new master, and the services restarted. is it possible to have true HA on the Hive Metastore without changing the connection string manually ?

Re: Configure HA database for Hive Metastore

Juanes — Mon, 14 Nov 2022 11:33:52 GMT

Hello,

did you tried to use a Loadbalancer like HAproxy?

I'm using Postgresql as HA internal database but for sure you can setup with both connections.

something like this:

frontend hive
bind *:10000
mode tcp
option tcplog
timeout client 50000
default_backend hive_backend

backend hive_backend
mode tcp
balance source
timeout connect 5000
timeout server 50000
server hiveserver1 Master1:10000
server hiveserver2 Master2:10000

Re: Configure HA database for Hive Metastore

asish — Mon, 14 Nov 2022 11:44:02 GMT

@KPG1 I can think of Oracle database ha a feature i.e Oracle RAC,where we give SCAN address as the jdbc string to metastore,so the scan ip wll take care of loadbalancing.

You need to check with mysql vendor(Oracle),if they have similar thing as of Oracle database.

You can have HMS HA but all the HMS instance point to same database, you can not have 2 HMS instance pointing to a different database.

Please let me know,if you have any querties and please "Accept As Solution", if your queries are answered