Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Set Impala table partition size?

Set Impala table partition size?

Hi.

 

Physicly impala table stores as planty of files. Does any methods to manage them? To set file-size? Any attribute?

1 REPLY 1
Highlighted

Re: Set Impala table partition size?

Rising Star
Hi,

We could specifies the maximum size of each Parquet data file produced by Impala INSERT statements.

By specifying "set PARQUET_FILE_SIZE=<size>"

Reference Link: https://www.cloudera.com/documentation/enterprise/latest/topics/impala_parquet_file_size.html

Impala partitioning and hive bucketing will also help in managing data

Link: https://www.cloudera.com/documentation/enterprise/latest/topics/impala_partitioning.html

Hope it helps. Let us know if any questions.

Thanks
Jerry
Don't have an account?
Coming from Hortonworks? Activate your account here