question Re: Hive Partition in Support Questions

Hive Partition

techshaj — Fri, 16 Sep 2022 14:19:54 GMT

Hive partition – I have set 10 partition in a table, how can I reduce it to 6 partition without dropping table from HDFS?

Re: Hive Partition

Shelton — Mon, 29 Apr 2019 04:12:10 GMT

You can use the below hdfs command

$ hdfs dfs -cat hive_table_data_folder/p* > new_file_name

Let me know whether that helped

Re: Hive Partition

EricL — Wed, 08 May 2019 04:12:20 GMT

I think the question was about Partitions, not Files?

Re: Hive Partition

EricL — Wed, 08 May 2019 04:15:36 GMT

I don't see super easy way, but below might help:

1. if this table is not external, make it external first:
ALTER TABLE <table> SET TBLPROPERTIES('EXTERNAL'='TRUE')

2. drop the table

3. create a new table and define same partition column

4. manually move files in another 4 partition directories into the 6 partition directories that you want to keep evenly

5. remove the empty directories under the table

6. msck repair table to recover the 6 current partitions

Hope above can help.

Eric