Impala and virtual columns

sergey.sheypak566881637 — Fri, 16 Sep 2022 08:49:10 GMT

Hi, imagine I do have a table:

CREATE TABLE partitioned_table(....)

PARTITIONED BY (fulldate String)

And a query:

select distinct(fulldate) from partitioned_table order by fulldate desc limit 100;

What would impala do? Only "virtual" (partition???) column takes place in query. Therese no need to fetch HDFS data.

It looks like right now Impala does read ALL partitions and calculated DISTINCT for a virtual column (virtual=is not present in data, this is metadata-only column)

Re: Impala and virtual columns

grahn — Fri, 18 Oct 2013 14:52:23 GMT

Sounds like something that could be done, so I've added a JIRA to track it.
https://issues.cloudera.org/browse/IMPALA-633

question Re: Impala and virtual columns in Archives of Support Questions (Read Only)

Impala and virtual columns

Re: Impala and virtual columns