- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to create hive table out of JSON Schema with s dynamic nested array
- Labels:
-
Apache Hive
Created 07-09-2024 12:43 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi all - I am trying to create a Hive table from nested JSON parquet data. The problem is one object is dynamic and I want to store it as a string since it changes.
Example JSON:
This will successfully create the table. I can query down all levels except "level5" falls apart. Is there a way I can cast the array in level5 into a string since it always changes??
FYI I have tried
Created 07-09-2024 02:26 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Maicat Welcome to the Cloudera Community!
To help you get the best possible solution, I have tagged our Hive experts @caio_contente @cravani who may be able to assist you further.
Please keep us updated on your post, and we hope you find a satisfactory solution to your query.
Regards,
Diana Torres,Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:
Created 07-30-2024 08:19 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Maicat You can not typecast array to the string. There are 2 ways you can use
1. Select the nth object of the array.
SELECT level5[0] AS first_genre FROM my_table;
WHere 0 is the first object
2. You can flatten it
SELECT column1 FROM my_table LATERAL VIEW explode(level5) genre_table AS level5;
