question Re: Impala has problems reading complex types from Parquet in Archives of Support Questions (Read Only)

Impala has problems reading complex types from Parquet

Pettax — Fri, 16 Sep 2022 10:53:46 GMT

Hi all,

I reported IMPALA-4725 last week but it seems like it has not been triaged yet. I wanted to bring some more attention to this issue (and possible suggestions for workarounds) since it has a heavy impact on us.

To summarize it seems like Impala mixes-up values in arrays of structs which to me seems like a fundamental problem in the parquet reader. Alternatively the values gets mixed-up when presented as a result.

Either way, I would very much appreciated an initiated persons view on this issue.

We are running Impala that is bundled with CDH 5.8.3

Br,

Petter

Re: Impala has problems reading complex types from Parquet

Tim Armstrong — Tue, 10 Jan 2017 18:03:57 GMT

Hi Petter,
This was on our radar - we usually triage anything with a "correctness"
label (which you added) periodically - it's obviously a serious issue. I
updated the JIRA.

- Tim

Re: Impala has problems reading complex types from Parquet

Pettax — Tue, 10 Jan 2017 19:34:14 GMT

Hi Tim,

thank you for taking the time to look at this issue!

Br,

Petter