Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Can a hive external table read .deflate files?

Can a hive external table read .deflate files?

Contributor

Our cluster is set to produce .deflate files, i have a pig script that produces a data set to an HDFS folder that i have an external table located on. Can the hive table read .deflate files? The .deflate file is in the directory, but when i query the table i get no results.

5 REPLIES 5

Re: Can a hive external table read .deflate files?

Hi @Josh Persinger

Are you able to get result with same table structure but in case of hive managed table? Issue may be related to the delimiter or actual file format.

Re: Can a hive external table read .deflate files?

Contributor

@Jitendra Yadav

I loaded the data into a hive managed table and it worked. Is there a special table property i have to create the external table with to be able to read the .deflate csv file?

Re: Can a hive external table read .deflate files?

can you please share the minimal reproducible steps so that i can reproduce this locally? Also kindly mentioned the HDP version.

Re: Can a hive external table read .deflate files?

Contributor

@Jitendra Yadav

1. Create external hive table with .csv parsing properties

2. Pig script produces compressed (.deflate) csv file to hdfs location of external table

HDP 2.4

Highlighted

Re: Can a hive external table read .deflate files?

Contributor

Could you please provide the hive DDL ?