Member since
11-11-2019
636
Posts
34
Kudos Received
27
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 962 | 10-09-2025 12:29 AM | |
| 8322 | 02-19-2025 09:43 PM | |
| 2437 | 02-28-2023 09:32 PM | |
| 5054 | 02-27-2023 03:33 AM | |
| 26752 | 12-24-2022 05:56 AM |
07-01-2021
10:28 AM
I see the two large tables are scanned and it is done at Map 1 phase and scanned around 9,569,213,817 records. predicate:(concat(trim(col1), trim(col2)) is not null and CAST( date_partition_col AS DATE) BETWEEN DATE'2021-02-04' AND DATE'2021-05-10') ==> scanning entire large table Can you try below one: create table mydb.mytbl as select col1,col2,...col18 where here date_partition_col between date_sub('2021-05-10',95) and '2021-05-10 from from mydb.tbl1 a inner join mydb.tbl2 b on concat(trim(col1),trim(col2))=colb;
... View more
06-30-2021
09:13 AM
I checked the driver documentation https://www.cloudera.com/documentation/other/connectors/hive-odbc/2-5-20/Cloudera-ODBC-Driver-for-Apache-Hive-Install-Guide.pdf , there is no way to force SNI .
... View more
06-27-2021
07:10 AM
As per HIVE-12192, by default, Hive displays timestamp in UTC. This article lists the Hive query commands that can be used to change the timestamp.
To display the current timestamp in Asia/Kolkata:
SELECT from_utc_timestamp(cast(from_unixtime(cast(current_timestamp() AS bigint)) as TIMESTAMP),"Asia/Kolkata")
To display a UNIX epoch number in Asia/Kolkata:
SELECT from_utc_timestamp(cast(from_unixtime(cast(1623943533 AS bigint)) as TIMESTAMP),"Asia/Kolkata") ;
... View more
Labels:
06-27-2021
06:45 AM
To list all the tables that are ACID(TRANSACTIONAL)/ NON_TRANSACTIONAL, perform the following steps:
Connect to the backend database
Execute "use hive" as all the tables are in the Hive database Note: Please check if the database name is different. This is specified at the time of creating the Hive service.
Execute the following to check for ACID table: select PARAM_KEY,PARAM_VALUE,TBL_NAME from TABLE_PARAMS,TBLS where PARAM_KEY='transactional' and PARAM_VALUE='true' and TABLE_PARAMS.TBL_ID=TBLS.TBL_ID;
OR, execute below to check for NON-TRANSACTIONAL table.
select PARAM_KEY,PARAM_VALUE,TBL_NAME from TABLE_PARAMS,TBLS where PARAM_KEY='transactional' and PARAM_VALUE='false' and TABLE_PARAMS.TBL_ID=TBLS.TBL_ID;
... View more
Labels:
06-14-2021
05:28 AM
Could you please provide screenshots? Whatis the proxy used? Is it Knox ?
... View more
05-03-2021
09:41 AM
@Raul23 Is datagrip a Java or non Java application? If it is a Java application. you need to use JDBC driver and use ODBC driver,if it is a non-java application. Download ODBC driver from https://www.cloudera.com/downloads/connectors/hive/odbc/2-6-9.html Driver JDBC drivers from https://www.cloudera.com/downloads/connectors/hive/jdbc/2-6-13.html Please select the latest driver. Please follow https://docs.cloudera.com/HDPDocuments/other/connectors/hive-jdbc/2.6.7/Simba-Hive-JDBC-Install-and-Configuration-Guide.pdf to configure
... View more
03-25-2021
07:01 AM
Can we track in a separate thread ? We need the queryId and the hiveserver2 logs
... View more
03-18-2021
05:55 AM
This is a known issue hash indexes are prone to become corrupted. HiveMetastore makes use of hash indexes for PostgreSQL and these corruptions cause issues. Affected Indexes: TC_TXNID_INDEX and HL_TXNID_INDEX Workaround: The workaround is to reindex the corrupted indexes. For example, in PostgreSQL run reindex index tc_txnid_index. And, If you use PostgreSQL as the backend database, a supported version later than 9.6 is recommended. You can refer the below link for more reference: https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/release-notes/content/known_issues.html
... View more
03-18-2021
02:13 AM
please change the property in Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml and Hive Service Advanced Configuration Snippet (Safety Valve) for hive-site.xml
... View more
01-12-2021
12:01 AM
Hive on spark is not supported on HDP 3.0.1 . You need to use Spark HWC and integrate with LLAP to take advantage, In HDP 3.x ,Tez is the default execution engine and you can also use MR.
... View more
- « Previous
- Next »