Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to confirm which types of compression enabled for a table

How to confirm which types of compression enabled for a table

New Contributor

I'm benchmarking some tables and want to confirm if and what type of compression has been enabled. My understanding is that there is input, intermediate/map and output compression -- is there a method to identify a table's compression status? I've set output compression like this:

 

SET hive.exec.compress.output=true;
SET mapred.max.split.size=256000000;
SET mapred.output.compression.type=BLOCK;
SET mapred.output.compression.codec=org.apache.hadoop.io.compress.SnappyCodec;


And then used INSERT OVERWRITE to populate a table. Then I used:

 

hive> desc formatted table_name;

 ...which displays compression: No. So I wonder which compression type status is displayed in desc formatted? And is there a way to learn all compression type status for a table?

 

2 REPLIES 2

Re: How to confirm which types of compression enabled for a table

Explorer
Hi
Yes I am also facing the same and looking for a solution, did you get the solution

Re: How to confirm which types of compression enabled for a table

New Contributor

Sorry, Sreeman, never got an answer. Even spoke to a few of the Cloudera engineers and it didn't seem to be a big issue with anybody else -- I gave up.