Created 04-20-2017 02:47 PM
Is there any limit on the size when creating struct column. for example
create table dd (id string array<struct<name :string,address:string ....5000 characters>>)
it creates a table but when i do a describe or select from that table its throwing error saying its expecting EOF at some 4000 character. My Metastore is mysql.
Created 04-20-2017 07:59 PM
Could you post the complete ddl and how you are trying to describe/access the table?
Created 04-20-2017 08:11 PM
create table dd (id string array<struct<name :string,address:string,more 400 cols >>)
table gets created but when i run
describe formatted dd or describe dd get the eol error.
Created 05-01-2017 04:21 PM
looks like this is failing because of mysql limitation on the column string length, because when we mention strcut as a data type and create a string which is more than some thing around 5000 string length , it fails. i think changing the metastore from mysql to oracle or other might solve it . for now I have taken another approach
Created 05-10-2018 09:10 PM
I have been facing the same issue .
InvalidObjectException(message:Invalid column type name length 2350 exceeds max allowed length 2000, type struct
I cannot change the metastore properties . is there any other way to increase the data type's length