Reply
New Contributor
Posts: 1
Registered: ‎06-09-2016

add partition progressively getting slower

Hi,

 

I'm running an 'alter table add partition' to an external impala table, and it runs progressively slower each time.

 

I add 4k partitions per day to the external table.  The dataset is about 22 million records in total.

 

It takes about 17 minutes to add all 4k partitions initially.  Second run of adding 4k partitions take 40 min.  The partition adds will progressively get slower until adding the partitions take several hours.

 

Can someone shed some light on what might be happening?

 

Thanks,

James

Highlighted
Contributor
Posts: 31
Registered: ‎10-27-2015

Re: add partition progressively getting slower

I would like to know as well.

Announcements