Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Parquet and Avro together.

Highlighted

Parquet and Avro together.

New Contributor

Hi, 

 

I have been reading about Parquet and I'm familiar with Avro.

I don't get to understand when it could be pretty good to use Parquet + Avro instance Parquet with textFile and what advantages could have Parquet + Avro. It seems that most people use Parquet + plainText.

 

Doesn't it make sense to use Parquet + Avro together?

 

 

 

 

 

 

 

1 REPLY 1

Re: Parquet and Avro together.

Champion Alumni

I have used  the combination in cases where the data model was changing over time and where it was complex.Its pretty easy to create an avro schema and the java bindings..There are cases where avro is a best fit over parquet.In case you are not sure it may be worthwhile to start with avro,do performace analysize and you can always change to parquet  very easily.

 

Nishan