Reply
Explorer
Posts: 23
Registered: ‎12-10-2018

Set Impala table partition size?

Hi.

 

Physicly impala table stores as planty of files. Does any methods to manage them? To set file-size? Any attribute?

Posts: 34
Topics: 0
Kudos: 8
Solutions: 3
Registered: ‎07-30-2018

Re: Set Impala table partition size?

Hi,

We could specifies the maximum size of each Parquet data file produced by Impala INSERT statements.

By specifying "set PARQUET_FILE_SIZE=<size>"

Reference Link: https://www.cloudera.com/documentation/enterprise/latest/topics/impala_parquet_file_size.html

Impala partitioning and hive bucketing will also help in managing data

Link: https://www.cloudera.com/documentation/enterprise/latest/topics/impala_partitioning.html

Hope it helps. Let us know if any questions.

Thanks
Jerry
Announcements