Reply
Explorer
Posts: 13
Registered: ‎08-23-2018
Accepted Solution

How do I create an impala table in an avro file that already has a map type?

[ Edited ]

Saved avro file's(raw data files, collect by flume) schema contains map type.

I want to create table using it.

I know Impala not support map type.

https://www.cloudera.com/documentation/enterprise/5-6-x/topics/impala_avro.html#avro_map_table

 

So, I removed the map type from the avro schema.( map type column remove )

Avro files still has map type data.

And, I create Hive and Impala table.

And, add partitions.

 

Hive table have rows.

But Impala no have rows.

Impala table query raise exception(complex type).

 

How do I create an impala table in an avro file(raw data) that already has a map type?

 

 

 

 

 

Highlighted
Cloudera Employee
Posts: 28
Registered: ‎11-17-2017

Re: How do I create an impala table in an avro file that already has a map type?

Impala checks the file formats here based on this enumeration. Currently skipping complex columns in scans is not supported for Avro.

Announcements