Member since
03-06-2020
398
Posts
54
Kudos Received
35
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
87 | 11-21-2024 10:12 PM | |
822 | 07-23-2024 10:52 PM | |
1071 | 05-16-2024 12:27 AM | |
3012 | 05-01-2024 04:50 AM | |
1335 | 03-19-2024 09:23 AM |
12-11-2024
04:09 AM
1 Kudo
Hi @sayebogbon Could you restart the CM agent on the hosts where Impala daemon is in bad health and also restart service monitor from CM and check it out? Regards, Chethan YM
... View more
11-21-2024
10:40 PM
1 Kudo
Hi @mrblack To avoid full table scan you follow these tips: 1. Ensure proper partition pruning: https://impala.apache.org/docs/build/html/topics/impala_partitioning.html#:~:text=the%20impalad%20daemon.-,Partition%20Pruning%20for%20Queries,-Partition%20pruning%20refers 2. Re write the query with sub queries. 3. Add explicit hints for join behaviour. Impala supports join hints like brodcast and shuffle that can influence query planning. After optimising check the explain plan. Regards, Chethan YM
... View more
11-21-2024
10:29 PM
Hi @xiaohai >What is the error you are seeing? >can you use this delimiter? impala-shell -B --output_delimiter='|' -q 'SELECT * FROM your_table' Regards, Chethan YM
... View more
11-21-2024
10:21 PM
Hi @ken_zz I think it is a below known BUG, Fix versions is NONE. https://issues.apache.org/jira/browse/HIVE-19689 Regards, Chethan YM
... View more
11-21-2024
10:12 PM
1 Kudo
Hi @pravin_speaks Can you export the below before running the sqoop command and see if it helps? export HADOOP_CLIENT_OPTS="-Dsqoop.oracle.escaping.disabled=false -Djava.security.egd="file:///dev/../dev/urandom" Regards, Chethan YM
... View more
11-15-2024
01:55 AM
1 Kudo
@luffy07 The given error message is generic when you are using JDBC driver to connect impala and it does not suggest the specific cause. Verify your Impala JDBC connection string is correct, port and Hosts are reachable etc.. Check Impala server that you are trying to connect is up and running fine, paste the memory errors here to understand what you are seeing in the logs. Also you can append the below into JDBC connection string and repro the issue , It will generate driver DEBUG logs and may give some more details about the issue. LogLevel=6;LogPath=/tmp/jdbclog And try to use the latest Impala JDBC driver that is avaible. https://www.cloudera.com/downloads/connectors/impala/jdbc/2-6-34.html Regards, Chethan YM
... View more
08-06-2024
10:06 PM
Hi @Supernova Can you try this? SELECT a.currency as currency, SUM(coalesce(a.ColA, 0) + coalesce(a.ColB, 0) + coalesce(a.ColC, 0) + coalesce(b.Col1, 0) + coalesce(b.Col2, 0) + coalesce(b.Col3, 0)) as sales_check FROM db.sales a INNER JOIN db.OTHER_sales b ON a.currency = b.currency WHERE a.DateField = '2024-06-30' AND b.DateField = '2024-06-30' GROUP BY a.currency; Regards, Chethan YM
... View more
08-06-2024
10:04 PM
Hi @Marks_08 To insert into a managed table from an external table created with HBase structure in CDP, you need to ensure that Hive can properly connect to HBase. This typically involves making sure that the Hive service is configured to access HBase correctly. One common issue is that the necessary configuration files, such as hbase-site.xml, are not accessible to Hive, leading to connection issues. Here’s what you can do to address this: 1. Copy hbase-site.xml to Hive Configuration Directory You need to copy the hbase-site.xml file to the Hive configuration directory. This file contains the necessary configuration for Hive to connect to HBase. sudo cp /etc/hbase/conf/hbase-site.xml /etc/hive/conf/ 2. Verify HBase Configuration Ensure that the hbase-site.xml file contains the correct configuration and points to the correct HBase nodes. The key configurations to check are: hbase.zookeeper.quorum hbase.zookeeper.property.clientPort These settings should correctly point to the Zookeeper quorum and client port used by your HBase cluster. 3. Restart Hive Service After copying the hbase-site.xml file, you might need to restart the Hive service to ensure it picks up the new configuration. 4. Check Hive and HBase Connectivity Make sure that the Hive service can properly communicate with HBase by running a simple query that accesses HBase data through Hive. Regards, Chethan YM
... View more
08-06-2024
10:00 PM
Hi @Supernova , Can you try this below? SELECT Currency, CASE WHEN COALESCE(SUM(ColA), 0) + COALESCE(SUM(ColB), 0) = COALESCE(SUM(ColC), 0) THEN 0 ELSE COALESCE(SUM(ColA), 0) + COALESCE(SUM(ColB), 0) - COALESCE(SUM(ColC), 0) END AS sales_check FROM Sales GROUP BY Currency; Regards, Chethan YM
... View more
07-23-2024
10:56 PM
@rizalt Yes, the Key Version Numbers (KVNO) of different principals can indeed be different. Each principal in Kerberos can have its own KVNO, which is an identifier that increments each time the key for that principal is changed. Reference: https://web.mit.edu/kerberos/www/krb5-latest/doc/user/user_commands/kvno.html#:~:text=specified%20Kerberos%20principals Regards, Chethan YM
... View more