- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Why do I have "incompatible Parquet schema" error after changing a column type from double to string ?
- Labels:
-
Apache Impala
Created ‎06-02-2021 12:36 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
File 'hdfs://xxx:8020/data/hive/warehouse/xxxx.db/test_bak/8743abe2968ecbe7-3f9c13700000000_2053286657_dat...' has an incompatible Parquet schema for column 'xxxx.test_bak.ordered_revenue'. Column type: STRING, Parquet schema: optional double ordered_revenue [i:20 d:1 r:0]
I made this change in Hue.
Created ‎06-04-2021 12:01 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello
The table column type must match the columnar file format of the Parquet file, else you will result in the error you got
One way if you prefer to use string instead of double for that data attribute, you can recreate the parquet file with the column type of string
Created ‎06-04-2021 12:01 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello
The table column type must match the columnar file format of the Parquet file, else you will result in the error you got
One way if you prefer to use string instead of double for that data attribute, you can recreate the parquet file with the column type of string
