Created on 11-28-2018 02:07 AM - edited 09-16-2022 06:56 AM
Saved avro file's(raw data files, collect by flume) schema contains map type.
I want to create table using it.
I know Impala not support map type.
https://www.cloudera.com/documentation/enterprise/5-6-x/topics/impala_avro.html#avro_map_table
So, I removed the map type from the avro schema.( map type column remove )
Avro files still has map type data.
And, I create Hive and Impala table.
And, add partitions.
Hive table have rows.
But Impala no have rows.
Impala table query raise exception(complex type).
How do I create an impala table in an avro file(raw data) that already has a map type?
Created 12-03-2018 09:01 AM
Impala checks the file formats here based on this enumeration. Currently skipping complex columns in scans is not supported for Avro.
Created 12-03-2018 09:01 AM
Impala checks the file formats here based on this enumeration. Currently skipping complex columns in scans is not supported for Avro.