08-14-2018 08:07 AM
08-21-2018 09:38 AM
Hi @Yurii thanks for the bug report - we'll look into it. What version of Impala did you see this on?
One thing worth trying is changing the PARQUET_ARRAY_RESOLUTION query option to THREE_LEVEL
We have sometimes seen similar symptoms with parquet nested types because of some ambiguity in encodings, e.g. https://issues.apache.org/jira/browse/IMPALA-4725. The original version of Impala's nested types defaulted to detecting an older representation of arrays first and we had to keep that behaviour in Impala 2.x/CDH5.x for backwards compatibility. In Impala 3.0/CDH6.0 we're defaulting to the standard array resolution method.