Reply
Highlighted
New Contributor
Posts: 4
Registered: ‎12-16-2015
Accepted Solution

Problems moving data between csv and avro tables

Hello All,

 

I've just recently started working with Impala and I'm running into an issue. If I run the following code in either the impala-shell or hue:

INSERT INTO orderdataagg_dav SELECT * FROM orderdataagg_dav_csv2;

I get this error:

Writing to table format AVRO is not supported. Use query option ALLOW_UNSUPPORTED_FORMATS to override.

What I'm trying to accomplish is moving data from a table that's Stored as Textfile to a different table that's Stored As Avro. From the Googleing I've done it looks like this is do able. So I'm wondering what I'm missing. Any help would be greatly appreciated. 

 

Cloudera Employee
Posts: 307
Registered: ‎10-16-2013

Re: Problems moving data between csv and avro tables

I'm afraid that Impala currently does not support writing Avro data. Even though you can enable experimental support, we strongly advise against that, and instead recomment using another tool such as Hive or Kite to do the conversion. My apologies for the inconvenience.

New Contributor
Posts: 4
Registered: ‎12-16-2015

Re: Problems moving data between csv and avro tables

That's what I was suspecting would be the answer after talking with a coworker, re-reading a Cloudera blog post, and experimentation Hive. I'll have to check into kite.