- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How do I create an impala table in an avro file that already has a map type?
- Labels:
-
Apache Hive
-
Apache Impala
Created on ‎11-28-2018 02:07 AM - edited ‎09-16-2022 06:56 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Saved avro file's(raw data files, collect by flume) schema contains map type.
I want to create table using it.
I know Impala not support map type.
https://www.cloudera.com/documentation/enterprise/5-6-x/topics/impala_avro.html#avro_map_table
So, I removed the map type from the avro schema.( map type column remove )
Avro files still has map type data.
And, I create Hive and Impala table.
And, add partitions.
Hive table have rows.
But Impala no have rows.
Impala table query raise exception(complex type).
How do I create an impala table in an avro file(raw data) that already has a map type?
Created ‎12-03-2018 09:01 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Impala checks the file formats here based on this enumeration. Currently skipping complex columns in scans is not supported for Avro.
Created ‎12-03-2018 09:01 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Impala checks the file formats here based on this enumeration. Currently skipping complex columns in scans is not supported for Avro.
