question Why do I have "incompatible Parquet schema" error after changing a column type from double to string ? in Support Questions

Why do I have "incompatible Parquet schema" error after changing a column type from double to string ?

Sunny93 — Wed, 02 Jun 2021 07:36:43 GMT

File 'hdfs://xxx:8020/data/hive/warehouse/xxxx.db/test_bak/8743abe2968ecbe7-3f9c13700000000_2053286657_data.0.parq' has an incompatible Parquet schema for column 'xxxx.test_bak.ordered_revenue'. Column type: STRING, Parquet schema: optional double ordered_revenue [i:20 d:1 r:0]

I made this change in Hue.

Daming Xue — Fri, 04 Jun 2021 07:01:02 GMT

Hello

The table column type must match the columnar file format of the Parquet file, else you will result in the error you got

One way if you prefer to use string instead of double for that data attribute, you can recreate the parquet file with the column type of string