Member since
05-21-2024
2
Posts
0
Kudos Received
0
Solutions
05-27-2024
08:39 PM
Hi had checked the "show processlist" and this query is running there and multiple time it's running problem is that it is scanning all rows, means not in optimize state and if it is auto generated query then how we can pass the partition information. and this query is not run by user, they are running optimize query it seems it taking some metadata from mysql, something like below..... So that's why i was thinking it meta generated query. | id | select_type | table | partitions | type | possible_keys | key | key_len | ref | rows | filtered | Extra | +----+-------------+-------+------------+-------+----------------------------------+-----------------+---------+-------------+---------+----------+-------------+ | 1 | SIMPLE | C0 | NULL | const | PRIMARY,UNIQUE_DATABASE,CTLG_FK1 | UNIQUE_DATABASE | 389 | const,const | 1 | 100.00 | Using index | | 1 | SIMPLE | B0 | NULL | const | PRIMARY,UNIQUETABLE,TBLS_N49 | UNIQUETABLE | 268 | const,const | 1 | 100.00 | Using index | | 1 | SIMPLE | A0 | NULL | ref | PARTITIONS_N49 | PARTITIONS_N49 | 9 | const | 5555098 | 11.11 | Using where
... View more
05-21-2024
05:45 AM
This is the query which is running on metastore_db SELECT `A0` . `PART_NAME` FROM `PARTITIONS` `A0` LEFT OUTER JOIN `TBLS` `B0` ON `A0` . `TBL_ID` = `B0` . `TBL_ID` LEFT OUTER JOIN `DBS` `C0` ON `B0` . `DB_ID` = `C0` . `DB_ID` WHERE `C0` . `NAME` = ? AND `C0` . `CTLG_NAME` = ? AND `B0` . `TBL_NAME` = ? AND `A0` . `PART_NAME` LIKE ? ESCAPE ? how we can optimize it ? Is it system generated? or from where it is coming at metastore_db database that is inside mysql. SELECT "AO" "PART NAME' FROM 'PARTITIONS AO' LEFT OUTER JOIN 'TBLS "RO' ON 'AO' • 'TBL ID' ** Note ** I am using Trino hive architecture. Thanks in advance for your help....
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Spark
-
Cloudera Analytic DB
-
Cloudera Data Engineering (CDE)
-
Cloudera Data Platform (CDP)
-
Cloudera Data Platform Private Cloud (CDP-Private)
-
Cloudera Data Science and Engineering
-
Cloudera Data Science Workbench (CDSW)
-
Cloudera Data Warehouse (CDW)
-
Cloudera DataFlow (CDF)
-
Cloudera Essentials
-
Cloudera Hue
-
Cloudera Machine Learning (CML)
-
Cloudera Manager
-
Cloudera Navigator
-
Cloudera Navigator Encrypt
-
Cloudera Navigator Key Manager
-
Cloudera Navigator Optimizer
-
Cloudera OnDemand
-
Cloudera Operational DB
-
Data Analytics Studio
-
Data Engineering UI
-
Data Lifecycle Manager
-
Data Steward Studio
-
Data Visualization
-
HDFS
-
Hortonworks Data Platform (HDP)
-
Hortonworks DataPlane
-
Hortonworks Operational Services
-
Hortonworks Stream Messaging Manager
-
Training