Member since
09-06-2023
1
Post
0
Kudos Received
0
Solutions
09-06-2023
03:58 PM
Hello, We need to partition 5 hive tables with more than 100 million records each. Tables have multiple columns to partition with integer and string data allowing less than 1000 partitions per column. Could we combine several of these fields to partition the tables? would there be a restriction on the maximum number of combined partitions? Should they have a specific order according to the number of partitions in each table? for example, first partition by year (10 partitions) , then by country (50 partitions) and then by city name (500 partitions) ? Must the combination of partitions be less than a particular number? Best Regards, H.M
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Impala