question Best way to create Hive table from XML file in Archives of Support Questions (Read Only)

Best way to create Hive table from XML file

grabowski14 — Thu, 01 Sep 2016 14:20:21 GMT

Hi. What is - in your opinion - the best way to import XML file into Hive table?

Is there any way to import XML file to Hive directly? My currently idea is: import XML to Oracle table, and then import Oracle table to Hive using Sqoop. Do you have better idea?

Re: Best way to create Hive table from XML file

pminovic — Thu, 01 Sep 2016 14:44:09 GMT

You can try a direct import using com.ibm.spss.hive.serde2.xml.XmlSerDe. Check https://community.hortonworks.com/content/kbentry/972/hive-and-xml-pasring.html and https://community.hortonworks.com/questions/40979/hive-xml-parising-null-value-returned.html for examples.

Re: Best way to create Hive table from XML file

uli_bethke — Tue, 17 Oct 2017 15:28:14 GMT

You can automate the whole process of generating ORC/Parquet for Hive in a relational structure. This blog post shows how to convert MISMO XML to Hive and Parquet

Re: Best way to create Hive table from XML file

max_boreback — Sat, 23 Feb 2019 19:03:35 GMT

Try this NIFI groovy processor it converts XML files to CSV or AVRO

https://github.com/maxbback/nifi-xml