Reply
Highlighted
New Contributor
Posts: 4
Registered: ‎09-23-2016

Impala Insert Overwrite Not Overwriting

Hi,


I'm running an insert overwrite into a a partitioned table and the table is not being truncated. No errors being thrown.
Is there any additional configuration required? I would expect the parquet files in each partition to be deleted before the insert.

 

INSERT OVERWRITE appends to the table's partitions
INSERT INTO appends to the table's partitions

 

Thanks,
Dáire

 

Table DDL template is that makes a difference.

 

CREATE TABLE IF NOT EXISTS schema.table (
columns columnTypes...)
PARTITIONED BY (KEY BIGINT)
STORED as PARQUET;

INSERT OVERWRITE TABLE schema.table partition(KEY)
columns,
composite_column_key as key
FROM other_schema.table;
Announcements