Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

WARNINGS: Error applying Kudu Op.: Incomplete: buffer size limit is too small to fit operation

WARNINGS: Error applying Kudu Op.: Incomplete: buffer size limit is too small to fit operation

New Contributor

While creating table , its failing with below error.


Query: CREATE TABLE REPORTKUDU
PRIMARY KEY(Marketing_Cloud_Visitor_ID)
PARTITION BY HASH(Marketing_Cloud_Visitor_ID) PARTITIONS 10
STORED AS KUDU TBLPROPERTIES('kudu.master_addresses'='X.X.X.X','kudu.num_tablet_replicas'='1')
AS SELECT * FROM REPORTN

 

 

WARNINGS: Error applying Kudu Op.: Incomplete: buffer size limit is too small to fit operation: required 52236317, size limit 10485760

Key already present in Kudu table 'impala::db.REPORTKUDU'. (1 of 9006 similar)

1 REPLY 1

Re: WARNINGS: Error applying Kudu Op.: Incomplete: buffer size limit is too small to fit operation

Cloudera Employee

I suspect that large number of "Key already present" errors may play a part in the initial buffer size warning.

 

The `Key already present in Kudu table 'impala::db.REPORTKUDU'. (1 of 9006 similar)` is telling you that

you are trying to insert records which are not unique. The table you are selecting from must have multiple records for each `Marketing_Cloud_Visitor_ID`. I would suggest writing the create table statement to ensure the primary key is unique, or adjusting the select statment to deduplicate the records before inserting into Kudu.

 

 

Don't have an account?
Coming from Hortonworks? Activate your account here