Member since
12-07-2015
83
Posts
23
Kudos Received
10
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2993 | 07-11-2018 02:42 PM | |
7993 | 12-10-2017 08:26 PM | |
2245 | 11-14-2017 12:17 PM | |
16442 | 03-29-2017 06:42 AM | |
2220 | 02-22-2017 01:43 PM |
02-02-2017
10:07 PM
@gaurang would you be open to sharing your CREATE TABLEs, CREATE VIEW and the query that has slow planning time? No need for the data, just that should be sufficient for us to understand better what's going on. Like Lars said, you are probably hitting IMPALA-4242 which explains the slow equivalence class computation, but I'd also like to understand the slow single-node planning time. Thanks!
... View more
02-02-2017
10:26 AM
1 Kudo
Sure thing, I'm glad you found the culprit. 🙂
... View more
01-29-2017
05:33 AM
Yes, I thought partitioning on the pattern of filename. For one type of data I have, it is acceptable since there are only 10-15 different types of file name. However; in another type of data, there is a unique "id" field on filename and this field's frequency is very high. So, there would be the threat of creation of lots of partitions which could be compelling for the catalog server.
... View more
11-02-2016
05:41 PM
1 Kudo
Hi Maurin, both tables have to be scanned to observe SQL semantics. Otherwise, we would be changing the number of results coming out of your view. If you want the drop the second union operand, you could add a "WHERE a IS NOT NULL", and then the seocnd table will not be scanned. Alex
... View more
11-02-2016
08:12 AM
Its working now, thanks.
... View more
05-02-2016
09:19 PM
There's no direct way to find out from the profile unfortunately. If you have a live system you can look at the /threadz page on the impala debug web page (port 25000 on each Impala daemon by default) to see how many hdfs-scan-node threads are running.
... View more
04-25-2016
06:51 AM
Thank you very much, Tim and Ivan. I have tested on customer system and with "set disable_codegen=1;" the query does NOT crash the whole impala cluster anymore. I will inform the customer and provide him with a link to this discussion
... View more
04-22-2016
08:18 AM
Hi Jaro, no, the JDBC and ODBC drivers are not open source projects. Best wishes, Lars
... View more
- « Previous
- Next »