Reply
New Contributor
Posts: 5
Registered: ‎05-04-2016

Error while running complex type samples Impala

My set up

CDH 5.7

CentOS release 6.6 (Final)

<imapala-shell>version;
Shell version: Impala Shell v2.5.0-cdh5.7.0 (ad3f5ad) built on Wed Mar 23 11:33:33 PDT 2016
Server version: impalad version 2.5.0-cdh5.7.0 RELEASE (build ad3f5adabedf56fe6bd9eea39147c067cc552703)

 

I am trying to understand and eventually use complex data types in Impala. I’m trying following instructions.
http://www.cloudera.com/documentation/enterprise/5-6-x/topics/impala_complex_types.html#complex_samp...

#Create flat_array table and insert data.
#Create complex_array table with array data type
#Insert data into complex_array
INSERT INTO complex_array SELECT country, collect_list(city) FROM flat_array GROUP BY country;
Query: insert INTO complex_array SELECT country, collect_list(city) FROM flat_array GROUP BY country
ERROR: AnalysisException: default.collect_list() unknown

How do I fix this ?
Is there a way to insert data into table without creating a flat table ?

Cloudera Employee
Posts: 437
Registered: ‎07-29-2015

Re: Error while running complex type samples Impala

You need to run the commands in that section in Hive - Impala doesn't support inserting complex types yet, just querying them.

Highlighted
New Contributor
Posts: 5
Registered: ‎05-04-2016

Re: Error while running complex type samples Impala

[ Edited ]

Thanks. Is there any pointers, tutorial, frameworks ( java ) to optimally write complex data formats in Parquet files ?