Support Questions
Find answers, ask questions, and share your expertise

Schema Evolution on Hive tables

Schema Evolution on Hive tables

New Contributor

I am trying to validate schema evolution using different formats (ORC, Parquet and AVRO). My source data is CSV and they change when new releases of the applications are deployed (like adding more columns, removing columns, etc). If i load this data into a Hive table as snapshot each day, how could i track these schema changes and read the data from these hive snapshots using the right schema definition. Is there any project which has implemented reading hive tables using dynamic schema definitions.

1 REPLY 1

Re: Schema Evolution on Hive tables

Contributor

Hi Bro,

got any solution on this ?