03-25-2019 11:44 PM - edited 03-25-2019 11:45 PM
While creating table , its failing with below error.
Query: CREATE TABLE REPORTKUDU
PARTITION BY HASH(Marketing_Cloud_Visitor_ID) PARTITIONS 10
STORED AS KUDU TBLPROPERTIES('kudu.master_addresses'='X.X.X.X','kudu.num_tablet_replicas'='1')
AS SELECT * FROM REPORTN
WARNINGS: Error applying Kudu Op.: Incomplete: buffer size limit is too small to fit operation: required 52236317, size limit 10485760
Key already present in Kudu table 'impala::db.REPORTKUDU'. (1 of 9006 similar)
03-29-2019 01:42 PM
I suspect that large number of "Key already present" errors may play a part in the initial buffer size warning.
The `Key already present in Kudu table 'impala::db.REPORTKUDU'. (1 of 9006 similar)` is telling you that
you are trying to insert records which are not unique. The table you are selecting from must have multiple records for each `Marketing_Cloud_Visitor_ID`. I would suggest writing the create table statement to ensure the primary key is unique, or adjusting the select statment to deduplicate the records before inserting into Kudu.