Member since
07-31-2016
7
Posts
1
Kudos Received
0
Solutions
07-31-2016
05:09 PM
Have you explored json serde - https://github.com/rcongiu/Hive-JSON-Serde ?? I would write a utility script that will convert your dataset to json (inclusive of serNo, Country, cities, date) and then load them into hive using json serde For more details on Hive Serde, refer to https://cwiki.apache.org/confluence/display/Hive/DeveloperGuide#DeveloperGuide-HiveSerDe
... View more
07-30-2016
02:23 PM
Thanks @Simon, I put into a string field in hive table and query it using get_json_object. That works for me. But i have another set of data in HDFS like. 1023,UK,{"cities":{"city1":"London","city2":"Birmingham","city3":"Liverpool"},"universities":{"universities1":"Cambridge","universities2":"Oxford"}},07-30-2016 So i want to store it in a hive table with schema like: create table data (SerNo int, country string , detail string,date string ) Then what should be the table definition so that {"cities: ..... } will come as one column and rest with other ? what should be the column separator ? If i put everything as one string field in hive table , then how i query SerNo ,country and date column. Is it possible by get_json_object ?
... View more