Reply
New Contributor
Posts: 5
Registered: ‎01-18-2015

Parquet and Avro together.

Hi, 

 

I have been reading about Parquet and I'm familiar with Avro.

I don't get to understand when it could be pretty good to use Parquet + Avro instance Parquet with textFile and what advantages could have Parquet + Avro. It seems that most people use Parquet + plainText.

 

Doesn't it make sense to use Parquet + Avro together?

 

 

 

 

 

 

 

Highlighted
Contributor
Posts: 156
Registered: ‎02-11-2014

Re: Parquet and Avro together.

I have used  the combination in cases where the data model was changing over time and where it was complex.Its pretty easy to create an avro schema and the java bindings..There are cases where avro is a best fit over parquet.In case you are not sure it may be worthwhile to start with avro,do performace analysize and you can always change to parquet  very easily.

 

Nishan

Announcements
The Kite SDK is a collection of docs, sample code, APIs, and tools to make Hadoop application development faster. Learn more at http://kitesdk.org.