Reply
Expert Contributor
Posts: 162
Registered: ‎07-29-2013
Accepted Solution

Impala IMPALA 1.1.1-1.p0.17 does not insert into partition

Hi, I've created partitioned table.

 

DROP TABLE IF EXISTS TEST_HOURLY;
CREATE EXTERNAL TABLE TEST_HOURLY(
weight        bigint,

tile_id          int,
zone_col        int,
zone_row        int,

top_left_lon    DOUBLE,
top_left_lat    DOUBLE,

bottom_right_lon DOUBLE,
bottom_right_lat DOUBLE
)
PARTITIONED BY(fulldate STRING)
ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'
STORED AS TEXTFILE;

ALTER TABLE TEST_HOURLY ADD PARTITION(fulldate='2013-10-09-07')

LOCATION 'hdfs://nameservice1/derivative/stream/TEST_HOURLY/2013-10-09-07';

 

The I do a query:

INSERT INTO TEST_HOURLY PARTITION(fulldate='2013-10-09-07')
SELECT
....

using impala-shell and see the respose:

Inserted 150588 rows in 21.93s

 

but partition folder  hdfs://nameservice1/derivative/stream/TEST_HOURLY/2013-10-09-07 is empty :(

 

Imapla did create partition under /user/hive/warehouse/fulldate=2013-10-09-07

How can I force Impala to create partition at the place I need?

 

 

Highlighted
Cloudera Employee
Posts: 307
Registered: ‎10-16-2013

Re: Impala IMPALA 1.1.1-1.p0.17 does not insert into partition

Sergey, I'm afraid that's simply a bug in Impala. My apologies.

I've filed https://issues.cloudera.org/browse/IMPALA-627 to track progress on the issue.