Cloudera Community
lucid
user rank
New Contributor

Re: Dynamic hive view creation

by New Contributor in Support Questions
‎10-16-2021 06:09 AM
‎10-16-2021 06:09 AM
Yes, that is the issue. Schema across all the tables is not same. For that we are trying to fill in NULL while using SELECT statement on each table for those columns which are not present in that table.  The changes for columns are not consistent accross tables. That is only few tables might update, few remain same.  ... View more

Re: Dynamic hive view creation

by New Contributor in Support Questions
‎10-15-2021 11:40 PM
‎10-15-2021 11:40 PM
What I mean by columns change is that table name will be same . New columns might be added or few existing columns might be removed. based on the columns available in the table at that point of time we need to create a VIEW with UNION ALL statement, with out manual intervention. ... View more

Dynamic hive view creation

by New Contributor in Support Questions
‎10-15-2021 04:57 AM
‎10-15-2021 04:57 AM
I have 10 hive tables, few columns might be similar in few tables, I need to union them into one table. I was writing Union all statements. Now, these columns in these 10 tables might change . how to create the Union all query dynamically based on the tables. ------------------------------------------------     CREATE VIEW comb_view AS SELECT col11, col12, col13,..... From (SELECT col11,col12,NULL col13 from tab1 UNION ALL SELECT col11,NULL col12, col13 from tab2 . . . . ) c ------------------------------------------------------- ensuring the position and data type. ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎11-04-2021 01:57 PM
Community Statistics
Member Since ‎10-15-2021 04:51 AM
Last Visited ‎11-04-2021 01:57 PM
Posts 3