Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Schema Evolution on Hive tables

avatar
New Contributor

I am trying to validate schema evolution using different formats (ORC, Parquet and AVRO). My source data is CSV and they change when new releases of the applications are deployed (like adding more columns, removing columns, etc). If i load this data into a Hive table as snapshot each day, how could i track these schema changes and read the data from these hive snapshots using the right schema definition. Is there any project which has implemented reading hive tables using dynamic schema definitions.

1 REPLY 1

avatar
Contributor

Hi Bro,

got any solution on this ?