Member since
10-28-2020
624
Posts
47
Kudos Received
41
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 767 | 01-21-2026 01:59 AM | |
| 3994 | 02-17-2025 06:54 AM | |
| 9567 | 07-23-2024 11:49 PM | |
| 2029 | 05-28-2024 11:06 AM | |
| 2763 | 05-05-2024 01:27 PM |
03-29-2022
12:02 PM
@mattyseltz what's the ODBC version you are using, and also could you share HDP/CDP version? It is possible that the said version of ODBC driver does not support the Hive version in use. Where did you download the 32-bit ODBC driver? If you do not see any detailed error, have you tried enabling DEBUG logging in ODBC driver, and see if that gives you more info?
... View more
03-24-2022
12:16 PM
2 Kudos
@Ging I don't think there is much in the liquibase extension that could impose security risks. But, it's better to check with Liquibase. About Hive and Impala JDBC drivers, you could download the latest from Cloudera website, and not 2.6.4/2.6.2 as mentioned in the Liquibase blog. Very soon we are going to release newer versions that address the recent log4j vulnerabilities.
... View more
12-16-2021
12:23 PM
@Gcima009 are you trying to collect the logs with the same user that you submitted the job with? This query completed the map phase, and failed in reducer phase. If you are not able to collect the app logs, do check the HS2 log with the query ID hive_20211210173528_ff76c3df-a33b-41d0-b328-460c9b65deda if you get more information what caused the job to fail.
... View more
12-15-2021
10:02 AM
@Gcima009 It will be difficult to say what's the issue is from this error stack. Could you generate yarn application log for this job, and review it or attach it here, or only paste the detailed error message? yarn logs -applicationId application_1639152705224_0018 > app_log.out
... View more
11-14-2021
01:59 AM
@mhchethan Yes, you could mention multiple LDAP URLs separated by spaces. Hive will try the URLs in the mentioned order until a connection is successful. Ref: hive.server2.authentication.ldap.url
... View more
11-14-2021
12:48 AM
1 Kudo
@HareshAmin As you correctly said, Impala does not support the mentioned OpenCSVSerde serde. So, you could recreate the table using CTAS, with a storage format that is supported by both Hive and Impala. CREATE TABLE new_table
STORED AS PARQUET
AS
SELECT * FROM aggregate_test;
... View more
10-16-2021
04:19 AM
@lucid will the column changes be consistent across all the tables? We could try "select * from <tbl1>", however it would require the schema of the table same in all the tables, else it will return semantic exception.
... View more
10-15-2021
02:46 PM
@lucid Do you mean, the position of the columns or the names of the columns change, or the data? As long as we are aware of the column names(data types should be consistent as well), we should be good to write our UNION statement. Please clarify if my understanding is wrong. As you want to write the physical data into a table, you could consider using Hive Materialised view. If your tables tab1, tab2 are ACID(transactional) tables, every time the data changes in those tables through any INSERT operation, the MV data also get refreshed.
... View more
10-10-2021
10:24 AM
2 Kudos
@Shab Set client socket timeout to 300( 5 mins). The value for "hive.metastore.event.listeners" needs to be set to blank(no value).
... View more
10-10-2021
01:12 AM
1 Kudo
@Shab no, those warn messages are not related. Did you try setting 'hive.metastore.client.socket.timeout' value to, 5 mins, under the "Service Monitor Client Config Overrides" in Hive configuration? We can completely disable Hive metastore canary, but I won't advise that. if Hive is working as expected, we could safely ignore these canary warnings, however, try setting the aforementioned socket timeout parameter, and that could help the canary tests perform without fail. If you use Sentry in your cluster, sometimes it blocks HMS, which in turn affects Metastore Canary. You could add the following property to overcome that. Navigate to Cloudera Manager > Hive > Configuration > "Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml" > add the following:
<property>
<name>hive.metastore.event.listeners</name>
<description>This will stop HMS blocking by Sentry</description>
<value></value>
</property>
... View more