Incompatible parquet Schema on Impala but queries work fine in Hive

[#1]

Hello ,

I am facing issues while executing some queries , I am getting below error for time being and the issue is being resolved autoamtically .

ERROR : File 'xxx/yyy/zzz/part-00000-c25df0cd-b7fa-4432-b416-16411dc390d4.c000.snappy.parquet' has an incomp...

I checked the files but there is no schema mismatch .

Can you please suggest me how i can fix the issue.

[#2 · Accepted solution]

@Muskan can you set this parameter before running the query and see if this helps?

set PARQUET_FALLBACK_SCHEMA_RESOLUTION=1;

Regards,

Chethan YM

[#3 · Accepted solution]

Hi @Muskan 

You can set it in CM Impala advance configs -> 

Impala Daemon Command Line Argument Advanced Configuration Snippet (Safety Valve)

Regards,

Chethan YM

[#4 · Accepted solution]

@Muskan can you set this parameter before running the query and see if this helps?

set PARQUET_FALLBACK_SCHEMA_RESOLUTION=1;

Regards,

Chethan YM

[#5]

Hello @ChethanYM 

It works 

But we can set as default property in our cloudera manager for impala 

[#6 · Accepted solution]

Hi @Muskan 

You can set it in CM Impala advance configs -> 

Impala Daemon Command Line Argument Advanced Configuration Snippet (Safety Valve)

Regards,

Chethan YM

[#7 · Accepted solution]

Thanks