question Parquet schema error in Support Questions

Parquet schema error

drgenious — Wed, 14 Jul 2021 11:56:10 GMT

I had a table that it vanished after an issue. I created again the table and then recover the partitions in order to read again the files that were in hdfs hive direcotry. Although all of a sudden now, it throws me the below error:

File 'path/data.0.parq' has an incompatible Parquet schema for column 'db.table.parameter_11'. Column type: STRING, Parquet schema: optional int64 amount [i:10 d:1 r:0]

Re: Parquet schema error

tarekabouzeid91 — Mon, 23 Aug 2021 23:07:14 GMT

Hi,

can you use beeline and type the below command then recreate the table :

set parquet.column.index.access=false;

this should make hive not use the index of your create table statement to map the data in your files, but instead it will use the columns names .

hope this works for you.

Best Regards