Hive Mysql Metastore Row lock increases

[#1]

Below is the query causing row locks in Mariadb Galera Cluster 10.2.32 (3Node Cluster).

select MT_COMMENT from AUX_TABLE where MT_KEY1='Cleaner' and MT_KEY2=0 for update

> Hive is a framework, we couldn't get the flow to understand also can't alter the logic from app end.

> Looking for solutions like any version that works in Mysql/Postgresql or any Metastore DBs that can scale for Hive Metastore without lockign issues.

> Also looking for any work around solution from DB end for this Mysql Row Locking.

[#2]

Welcome to the community @Mannoj. I'm not an expert but while you wait for one, I found this article/video on Hive Locking Mechanism. Hopefully it moves you closer in the right direction. 

[#3]

@cjervis These are locks in Hive, we have a mysql backend for metastore and that keeps locking in above mentioned query. Whenever the row locks increase at mysql end we will face issues in hive in processing queries and backlog builds.

[#4]

Thank you for the clarification. Hopefully someone will be able to assist.

[#5]

@Mannoj RDBMS HA for metastore is not officially supported yet. We have a knowledge article on the same. Cloudera's statement on RDBMS HA can be found here.

[#6]

Just got the article access. By the way this issue occurs in mysql even not a galera cluster types. even i make the same Mariadb as master / slave, the same issue occurs, so this is not the problem with galera cluster, is for sure.

[#7]

I dont have cloudera enterprise login. So can’t check. Such KA can be open
to public.