Support Questions

Find answers, ask questions, and share your expertise

Set Impala table partition size?

Hi.

 

Physicly impala table stores as planty of files. Does any methods to manage them? To set file-size? Any attribute?

1 REPLY 1

Rising Star
Hi,

We could specifies the maximum size of each Parquet data file produced by Impala INSERT statements.

By specifying "set PARQUET_FILE_SIZE=<size>"

Reference Link: https://www.cloudera.com/documentation/enterprise/latest/topics/impala_parquet_file_size.html

Impala partitioning and hive bucketing will also help in managing data

Link: https://www.cloudera.com/documentation/enterprise/latest/topics/impala_partitioning.html

Hope it helps. Let us know if any questions.

Thanks
Jerry
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.