Member since
03-06-2020
406
Posts
56
Kudos Received
37
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1120 | 08-29-2025 12:27 AM | |
| 1654 | 11-21-2024 10:40 PM | |
| 1558 | 11-21-2024 10:12 PM | |
| 5337 | 07-23-2024 10:52 PM | |
| 3029 | 05-16-2024 12:27 AM |
09-05-2022
05:05 AM
1 Kudo
Hi @Iga21207 , So how it works in catalod is when you run any refresh commands then that is executed sequentially and once that is completed then it goes to next one. It doesn't run in parallel as per the catalogd which is a single threaded operation. There is a lock that catalogd thread creates on class getCatalogObjects(). So when you are refreshing(means they have not completed yet sequentially) and after that when the new request came in then the Catalog threw the error on that table as it can't get the lock because the lock is already there on previous table on which the refresh command was running. Not sure on your CDH version, This may resolved in Higher version of CDP/CDH. Note: If i answered your question please give a thumbs up and accept it as a solution. Regards, Chethan YM
... View more
08-29-2022
05:21 AM
2 Kudos
Hi, After you run the query you need to look at the query profile to analyse the complete memory. look for “Per node peak memory usage” in the profile to understand how much memory each host or impala daemon used to run this query. For above snippet from your side it looks like this query has the 3gb max limit to run the query, this can be set at session level or in impala admission control pool. If you provide the complete query profile i think we can get more details. Regards, Chethan YM
... View more
08-29-2022
05:07 AM
1 Kudo
Hi, Yes, Hive metastore is a component that stores all the structure information(metadata) of objects like tables and partitions in the warehouse including column and column type information etc... Regards, Chethan YM Note: If this answered your question please accept the reply as a solution.
... View more
07-14-2022
07:33 AM
1 Kudo
Hi Vidya , Issue has been resolved by setting path : export PATH=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin:/usr/bin/python2:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/anaconda3/bin:/opt/anaconda3/condabin
... View more
07-04-2022
03:10 AM
@MOMIE2005 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
... View more
06-24-2022
08:59 AM
Hi Chethan Thanks for the reply as per your examples 1. select name from census where year=2010; This works fine ie it only queries the partition but our problem is when the condition is not a literal like ='2010' but when we try to dynamically retrieve the data like your second example We are finding that the query scans the whole table not just the partition - ie takes much longer in larger tables
... View more
05-31-2022
03:22 AM
Hi @wert_1311 It shows the number of impalad connections are hitting the limit. You can check on these below points: 1. you can increase the value of "Impala Daemon Max Client Connections" property in the impala configs if really more number of connections are coming. 2. If you think the connections are less but the opened connections are not closing properly and causing the issue you can check the timeouts has been set properly in the Hue safety-valve advance configs. -idle_session_timeout=3600 -idle_query_timeout=3600 Regards, Chethan YM
... View more
05-31-2022
03:04 AM
Hi @ChethanYM , Thanks for the help, gracefully shutting down the region server triggers the hbase Master to perform a bulk assignment of all regions hosted by that region server. regards, KPG1
... View more
04-29-2022
05:34 AM
hi @ChethanYM unfortunately we need to do this type of blocking only in IMPALA, in HIVE it has to work normally. when blocking by sentry, it will be replicated for any type of access that the user will use, such as hive, impala, beeline, etc.
... View more
04-25-2022
12:17 AM
Thank you for the attention, the Principal name is complete and correct. Impala Catalog and Impala Server will report an error: 9236 authentication.cc:177] SASL message (Kerberos (internal)): GSSAPI Error: Unspecified GSS failure. Minor code may provide more information (Server krbtgt/statestore_hostname@TEST.COM not found in Kerberos database) When I set "-skip_internal_kerberos_auth=true", only Coordinator gets this error. When I set "-skip_internal_kerberos_auth=true" and "-skip_external_kerberos_auth=true", all components are fine, but then Kerberos authentication is lost.
... View more