Parquet schema error

[#1]

I had a table that it vanished after an issue. I created again the table and then recover the partitions in order to read again the files that were in hdfs hive direcotry. Although all of a sudden now, it throws me the below error:

File 'path/data.0.parq' has an incompatible Parquet schema for column 'db.table.parameter_11'. Column type: STRING, Parquet schema: optional int64 amount [i:10 d:1 r:0]

[#2 · Accepted solution]

Hi,

can you use beeline and type the below command then recreate the table :

set parquet.column.index.access=false; 

this should make hive not use the index of your create table statement to map the data in your files, but instead it will use the columns names .

hope this works for you.

Best Regards