Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Hive Error when reading empty parquet files
Labels:
- Labels:
-
Apache Hive
New Contributor
Created on ‎08-10-2017 02:09 AM - edited ‎09-16-2022 05:04 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello everyone i'm currently using CDH 5.9.1 on queries when Hive tries to read empty Parquet files I get "Parquet file is not a Parquet file (too small)" error . Is there particular setting that i can give to HIve to skip empty files?
Regards
Francesco
1 REPLY 1
Super Guru
Created ‎08-20-2017 10:41 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Francesco,
Why do you need to read from an empty parquet file? Can you simply remove them?
Have you also tried to use parquet-tools command line utility to confirm if the parquet file is valid?
Why do you need to read from an empty parquet file? Can you simply remove them?
Have you also tried to use parquet-tools command line utility to confirm if the parquet file is valid?
