How do I create an impala table in an avro file that already has a map type?

avengers — Fri, 16 Sep 2022 13:56:08 GMT

Saved avro file's(raw data files, collect by flume) schema contains map type.

I want to create table using it.

I know Impala not support map type.

So, I removed the map type from the avro schema.( map type column remove )

Avro files still has map type data.

And, I create Hive and Impala table.

And, add partitions.

Hive table have rows.

But Impala no have rows.

Impala table query raise exception(complex type).

How do I create an impala table in an avro file(raw data) that already has a map type?

Re: How do I create an impala table in an avro file that already has a map type?

tmater — Mon, 03 Dec 2018 17:01:59 GMT

Impala checks the file formats here based on this enumeration. Currently skipping complex columns in scans is not supported for Avro.