question How to use compression with Kudu tables? in Archives of Support Questions (Read Only)

How to use compression with Kudu tables?

AKB — Fri, 16 Sep 2022 13:05:52 GMT

Looking for documentation. Using Impala on Kudu at the moment.

Found https://kudu.apache.org/docs/schema_design.html , says Kudu allows compression on a column level. How about if I wanted table level?

Thanks.

Re: How to use compression with Kudu tables?

Dan Burkert — Thu, 12 Apr 2018 16:55:18 GMT

Hi AKB, there's no table-level compression. The closest equivalent would be specifying compression for all columns. It's pretty typical to rely on encodings to reduce size as much as possible, and then additionally apply compression only for particularly big or cold columns.

Re: How to use compression with Kudu tables?

AKB — Thu, 12 Apr 2018 18:59:13 GMT

Can you please direct me to some docs that say how to set encodings and how to declare column level compression? I am not able to find this. Thanks.

Re: How to use compression with Kudu tables?

Dan Burkert — Thu, 12 Apr 2018 19:03:21 GMT

Hi AKB,

Assuming you're asking about Impala, you can find the exact syntax for creating tables with compressed/encoded columns in the CREATE TABLE reference, and the syntax for altering tables to add compression/encodings in the ALTER TABLE reference.