I want to convert JSON schema to Avro schema and hive DDL and then insert it into the table. The schemas I have are a multi-referenced chained schemas. I wrote a processor which validates JSON agaisnt JSON schema but Im unable to find any library for the above-mentioned tasks.
Two questions. Is converting Json schema to Avro is a good idea? because currently I've to write avro schema by hand. i want to automate it. second. If yes, then how to do it or how should I proceed? Any help would be appreciated.
If you need to convert JSON to ORC (for Hive) Avro will be required. You will need to write/manage Avro schemas (recommended will be to use Schema Registry for that). Alternatively you can use Infer Avro schema to detect incoming schema from JSON but it may not be 100% correct all the time.