Member since
07-17-2017
143
Posts
16
Kudos Received
17
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1453 | 07-03-2019 02:49 AM | |
1640 | 04-22-2019 03:13 PM | |
1385 | 01-30-2019 10:21 AM | |
8033 | 07-25-2018 09:45 AM | |
7115 | 05-31-2018 10:21 AM |
08-08-2019
12:09 AM
Hi @Zane- This is an OOM (Out If Memory) error, it simply means that this query needs more memory to be completed; it usually occurs when the cluster is in charge. The request has exceeded the existing memory. The solution is to add more memory to your nodes or to add more nodes. Otherwise, try to optimize your queries, and you can make sure that your impala setting is optimal too. https://www.cloudera.com/documentation/enterprise/latest/topics/impala_performance.html Good Luck.
... View more
07-04-2019
07:05 AM
Have you made any manual changes to the metastore user or database permissions? because it looks like the DBS table is not found in metastore DB! Remark: check if the CM point to the correct metastore DB with the pertinent user.
... View more
07-04-2019
02:22 AM
Hi @andreas It looks like you have a connectivity issue with hive metastore.. try to put off the firewall and test. Else, please share with us those log files: /var/log/hive/hadoop-cmf-hive-HIVEMETASTORE-XXXX.log.out /var/log/impalad/impalad.hdm1.emd.impala.log.INFO.YYYYYYY Good luck
... View more
07-03-2019
02:49 AM
HI @punshi Do you use the QuickStart VM for CDH 5.13? Indeed, the VM is just for testing !! To unlock the real power of the impala (CDH), you should have a cluster so that you can benefit from the senergy of several nodes. Anyway, you can improve your query time by: 1- Set PARQUET_FILE_SIZE = 256MB instead of 512MB. 2- Try to minimize the number of partitions (in fact, I think in your case, the year is sufficient). NB: I think that in a cluster that has more than 10 nodes, this request will not exceed 2 to 4 seconds. Good luck.
... View more
05-06-2019
04:42 PM
Hi @anis447 Can you bring us this queries results in SQL server and Impala: Select avg(tagno) from tag;
Select avg(tagno) from has_tag;
Select count(*) from tag where tagno is null;
Select count(*) from has_tag where tagno is null; Also try to add this on Impala query, and let us know if there is any change: ...
Inner join has_tags hit on (s.tagno = hit.tagno and s.categorycode = hit.categorycode)
... Good luck.
... View more
04-28-2019
03:35 AM
1 Kudo
Hi @bridgor It looks like you have a firewall issue between your nodes.. try to check iptables. Please share with us the impalad log files. Good luck.
... View more
04-22-2019
03:13 PM
Hi, the unix_timestamp function return a number of seconds but it seems that ipid.bk_eff_strt_dt column is inserted with the milliseconds number!? About your query try this: SELECT COUNT(*) FROM ipid WHERE unix_timestamp('20190124',"yyyyMMdd")*1000 BETWEEN ipid.BK_EFF_STRT_DT AND ipid.BK_EFF_END_DT; Good luck.
... View more
02-09-2019
04:47 AM
Hi @Tim Armstrong While IMPALA-1618 steel open and unresolved, I confirmed that this "workaround" is safe and efficient (I'm using it on a large scope and during more than 9 months) so that this is the only solution I find to solve or -get around- this big problem. Hope that the main problem will be fixed ASAP. Thanks for the remark.
... View more
02-09-2019
04:29 AM
Hi @Bishnup If you still have the same problem please try to share with us your URL string.
... View more
01-30-2019
10:21 AM
Hi @Rr, Please give us more details, errors messages or screenshots so we can help you.
... View more