Reply
New Contributor
Posts: 3
Registered: ‎07-02-2016

Hive Error when reading empty parquet files

Hello everyone i'm currently using CDH 5.9.1  on queries when Hive tries to read empty Parquet files I get "Parquet file is not a Parquet file (too small)" error . Is there particular setting that i can give to HIve to skip empty files?

 

Regards

 

Francesco

Cloudera Employee
Posts: 177
Registered: ‎03-23-2015

Re: Hive Error when reading empty parquet files

Hi Francesco,

Why do you need to read from an empty parquet file? Can you simply remove them?

Have you also tried to use parquet-tools command line utility to confirm if the parquet file is valid?
Announcements